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ABSTRACT 

The  purpose  of  this  paper  is  to  introduce  a  new  spline  approxi¬ 
mation  scheme  for  retarded  functional  differential  equations.  The 
special  feature  of  this  approximation  scheme  is  that  it  preserves 
the  product  space  structure  of  retarded  systems  and  approximates  the 
adjoint  semigroup  in  a  strong  sense.  These  facts  guarantee  the  con¬ 
vergence  of  the  solution  operators  to  the  differential  Riccati  equa¬ 
tion  in  a  strong  sense.  Numerical  findings  indicate  a  significant 
improvement  in  the  convergence  behaviour  over  both  the  averaging  and 
the  previous  spline  approximation  scheme. 

Furthermore,  controllability  and  observability  criteria  are 
given  for  the  approximating  systems,  which  are  shown  to  be  stable 
respectively  stabilizable  for  sufficiently  large  N  provided  that 
the  underlying  retarded  system  has  the  same  property. 
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SIGNIFICANCE  AND  EXPLANATION 


For  a  large  number  of  problems  in  engineering  and  biology 
appropriate  mathematical  models  involve  functional  differential 
equations  (FDE)  which  in  turn  can  be  reformulated  as  ordinary 
differential  equations  (ODE)  in  infinite  dimensional  state  spaces. 
This  paper  is  concerned  with  the  approximation  of  these  equations 
by  a  sequence  of  finite  dimensional  ODEs.  A  particular  emphasis 
is  placed  on  the  approximate  solution  of  the  linear  quadratic 
optimal  control  problem.  The  approximation  scheme  is  based  upon 
a  projection  of  the  underlying  function  space  onto  a  spline  sub¬ 
space.  The  special  feature  of  this  scheme  is  that  it  preserves 
to  product  space  structure  of  the  FDE  and  approximates  the  optimal 
feedback  law  on  the  strong  operator  topology.  A  number  of  numerical 
examples  indicate  a  significant  improvement  in  the  convergence 
behaviour  over  previously  developed  approximation  schemes  for  FDEs . 


The  responsibility  for  the  wording  and  views  expressed  in  this 
descriptive  summary  lies  with  MRC,  and  not  with  the  authors  of  this 
report . 
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F.  Kappel  '  and  D.  Salamon  ' 

1.  Introduction 

In  this  paper  we  introduce  a  new  spline  approximation  scheme 
for  linear  time  invariant  retarded  functional  differential 
equations  (RFDEs)  and  establish  a  number  of  convergence  results 
and  structural  properties  for  this  scheme.  In  particular  we  show 
that  the  approximate  feedback  law  and  the  solution  of  the  operator 
Riccati  equation,  associated  with  the  linear  quadratic  control 
problem  for  this  class  of  systems,  converge  in  the  uniform  operator 
topology. 

The  first  step  of  the  general  approach  is  to  transform  the  RFDE 
x(t)  =  Lxt  +  BQu(t ) ,  y(t )  *  CQx(t)  (1.1) 

into  an  abstract  Cauchy  problem  of  the  form 

^  x(t)  *  Ax(t)  +  Su(t ),  y (t )  =  Cx(t )  (1.2) 

in  the  Hilbert  space  X  s 3Rn  *  L2l-h,0 3RnJ ,  h  >  0,  where  A  is  the 
infinitesimal  generator  of  the  strongly  continuous  semigroup  S(t) 
which  is  associated  with  the  uncontrolled  delay  equation.  For 
systems  of  the  form  (1.2)  there  exists  a  general  theory  of  the 
linear  quadratic  control  problem  of  minimizing  the  cost  functional 
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T 

J(u)  =  /  l |y(t)  |2  ♦  |u(t) |2]dt 
0 

(see  e.g.  f 9 1 ,  (151,(201).  The  optimal  control  can  be  characterized 
as  a  feedback  law  which  is  determined  by  an  operator  satisfying 
the  differential  Riccati  equation  (in  the  case  T <  •)  respectively 
the  algebraic  Riccati  equation  (in  the  case  T  =  •).  These  operator 
Riccati  equations  involve  both  the  original  generator  A  and  its 
adjoint  operator  A*.  Therefore,  in  order  to  approximate  the  feedback 
law  and  the  Riccati  operator  in  the  strong  operator  topology,  we 
have  to  approximate  both  semigroups  S(t)  and  S*( t)  in  the  strong 
operator  topology  (see  1211). 

For  the  approximation  of  the  semigroups  we  use  a  Galerkin 
type  scheme,  i.e.  we  define  finite  dimensional  subspaces  X*1  of  X 
and  operators  AN  on  XN  which  generate  semigroups  ^(t)  on  XN.  The 

classical  idea  is  to  choose  XN  c  dom  A  and  define  AN  =  pNApN  where 

N  M 

p  is  the  orthogonal  projection  of  X  onto  X  .  Under  appropriate 

consistency  and  stability  hypotheses  the  convergence  of  SN(t)  to 

S(t)  in  the  strong  operator  topology  follows. 

These  ideas  have  been  used  by  Banks  and  Kappel  (71  for  the 

development  of  a  spline  approximation  scheme  for  RFDEs  and  have 

then  been  applied  to  problems  of  optimal  control  and  parameter 

identification  e.g.  in  131*  161,  181,  [261.  In  particular,  Kunisch 

(261  has  estabilished  weak  convergence  results  for  the  solution 

operators  of  the  differential  Riccati  equations.  Numerical  findings 

in  (81  indicate  that  these  operators  indeed  do  not  converge  strongly 

for  the  spline  scheme  developed  in  (71.  Furthermore,  it  can 

N 

actually  be  shown  that  the  adjoint  semigroups  S  (t)*  cannot  converge 
strongly  in  that  scheme.  The  main  reason  for  this  is  that  the 
subspace  X  in  17 1  has  been  chosen  to  be  contained  in  the  domain 
of  A  which  is  different  from  the  domain  of  A*. 

In  order  to  overcome  this  unequal  treatment  of  S(t)  and  S*(t), 

our  first  idea  was  to  introduce  two  spline  subspaces  XN  c  dom  A  and 

V.  c  dom  A*  and  to  make  use  of  the  non  orthogonal  projections  of  X 
N  NX 

onto  X  along  (V  )  .  Unfortunately,  we  found  out  after  lots  of 
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calculations  that  these  projection  operators  did  not  converge 

strongly  to  the  identity.  The  second  (successful)  idea  was  then 

N 

to  enlarge  the  subspace  X  such  that  it  is  neither  contained  in 

dom  A  nor  in  dom  A*,  but  contains  sufficiently  many  elements  of 

both  domains.  Of  course,  in  this  situation  the  approximating 

N  mm 

operators  can  no  longer  be  defined  by  A  =  p  Ap  but  have  to  be 

defined  directly  instead  (for  details  see  Section  4.3).  As  a 
result  we  are  able  to  establish  the  desired  convergence  of  the 
solution  operators  of  the  Riccati  equation  in  the  uniform  operator 
topology  for  the  finite  time  horizon  problem.  Despite  the  fact  that 
in  the  case  of  the  infinite  time  horizon  problem  our  scheme  always 
did  converge  numerically,  we  were  not  able  to  prove  this  convergence 
following  the  approach  presented  in  121).  The  reason  is  that  we 
do  not  have  the  uniform  (with  respect  to  N)  exponential  stability 
of  the  approximating  semigroups  for  our  scheme  (compare  Section  5.4). 
In  this  respect  the  spline  approximation  scheme  differs  from  the 
averaging  approximation  scheme  in  (4)  for  which  the  uniform 
exponential  stability  property  has  been  established  in  [ 37  J . 

In  two  preliminary  sections  we  collect  some  basic  facts  from 
the  state  space  and  control  theory  of  retarded  systems  (Section  2) 
and  give  a  short  survey  on  the  theory  of  the  linear  quadratic 
optimal  control  problem  for  abstract  systems  in  Hilbert  space  and 
for  RFDEs  (Section  3).  In  Section  4.1  we  present  a  general 
approximation  scheme  for  abstract  Cauchy  problems  in  Banach  space. 

In  Section  4.2  we  consider  the  problem  of  approximating  the 
feedback  law  for  the  finite  time  horizon  problem  following  the 
approach  given  in  Gibson  in  (21).  The  main  part  of  this  paper  is 
Section  4.3  where  we  develop  a  special  spline  scheme  and  prove 
convergence  results  along  the  general  ideas  given  in  Section  4.1 
and  4.2.  We  also  give  the  explicit  formulae  for  the  matrices  which 
are  necessary  for  the  implementation  of  our  scheme.  This  scheme 
has  remarkable  qualitative  properties  which  are  presented  in 
Section  5.  First  of  all,  the  product  space  structure  of  the  under¬ 
lying  RFDE  (1.1)  is  preserved  and  there  is  a  structural  operator 
playing  an  important  role  for  the  approximating  systems  (Section  5.1). 


Secondly,  there  exist  convenient  criteria  for  stability, 
controllability,  observability,  stabilizability  and  detectability 
of  the  approximating  systems  (Section  5«2).  The  main  results  of 

Section  5  are  that  the  stability,  stabilizability  or  detectability 
of  the  delay  system  imply  the  same  properties  for  the 
approximating  systems  provided  that  N  is  sufficiently  large  and 
that  the  approximating  systems  cannot  be  stable  in  a  uniform 
sense  with  respect  to  N  (Section  5.^). 

Finally,  in  Section  6  we  present  some  of  the  many  numerical 
calculations  in  order  to  demonstrate  the  good  behaviour  of  our 
scheme  and  the  significant  improvement  in  the  convergence  property 
over  both  the  averaging  approximation  scheme  (41,  (21!  and  the 
spline  scheme  in  17 J,  (81. 


2.  State  space  theory  for  linear  hereditary  control  systems 


In  the  following  we  define  the  type  of  hereditary  control 
systems  to  be  considered  in  this  paper  (Section  2.1)  and  collect 
some  well  known  facts  on  the  state  space  description  of  retarded 
functional  differential  equations  (RFDEs)  in  terms  of  semigroups 
and  evolution  equations  (Section  2.2).  Then  we  outline  the  basic 
duality  relations  (Section  2.3)  and  briefly  review  some  of  the 
existing  results  on  the  structural  and  control  properties  of 
hereditary  control  systems  (Section  2.4). 

2.1.  Linear  hereditary  control  systems 

We  consider  the  linear  hereditary  control  system 

£(t)  *  Lxt  +  BQu(t),  t  >  0,  ( 2 . 1  ;1 ) 

y(t )  =  CQx(t),  (2 .1  ;2 ) 

where  x(t)  e  3Rn,  u(t)  e  ]Rg,  y(t)  e  3Rra  and  xfc  is  defined  by 

xfc(s)  =  x(t+s)  for  -h  ^  s  _<  0,  h  >  0.  Correspondingly  Bfl  and  CQ 

are  real  matrices  of  appropriate  dimensions  and  L  is  a  bounded 
linear  functional  C(-h,0jIRn)  ■*  TRn  given  by 

0 

L4  =  /  [dn(t)]^(t) 

-h 

p  0 

=  l  A ,$(-h . )  ♦  /  Ani(T>*(t)dT,  *  €  C(-h,oaRn), 
j  =0  J  J  -h  U1 

where  0  =  hft  <  ...  <  hD  s  h  and  A.  g  ]Rn*n,  j  =  0,...,p,  as  well 

"  p  ^  J  n  xn 

as  A01(O  e  IT  (-h,0;Rnxn) .  Clearly,  the  function  n:  3R  2R  of 

bounded  variation  is  of  the  form 

"(t)  *  '  jlj  Aj*<— ,-hj  J<T> 

0 

-  J  A01(o)do ,  t  e  3R, 
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I 


where  xT  denotes  the  characteristic  function  of  the  interval  I. 

*  O  r> 

A  solution  of  (2.1:1)  is  a  function  x(*)  €  L f _ (-h,»iIR  )  which 

2  loc 

is  absolutely  continuous  with  L  -derivative  on  every  compact 
interval  10, Tl,  T  >  0,  and  satisfies  (2.1;1)  for  almost  all  t  _>  0. 
It  is  well  known  that  (2.1;1)  admits  a  unique  solution 
x(t)  =  x(t;$,u)  for  every  input  u(*)  e  L^oc(0,*jIR  )  and  every 
initial  condition 

x(0)  =  *°,  x( t )  =  ♦1(t)>  -h  <  x  <  0,  (2.2) 

where  ♦  =  (♦°,*1)  €  M2  =  Bn  *  L2(-h,0jIRn)..  Moreover,  x(  •;<!>, u) 
depends  continuously  on  4  and  u  on  compact  intervals,  i.e.  for 
any  T  >  0  there  exists  a  K  >  0  such  that 

sup  |x(t ;  $,u)  1  <  K  (||  ♦  ||  +  ||u||  ?  ), 

0<t<T  L  (0,TjIR  ) 

where  ||  +  ||  =  ( 1 4>° 1 2  +  U1|2P)1/2  for  *  e  M2(see  e.g.  [131,1191). 

ir 

The  fundamental  solution  of  (2.1  ;1)  will  be  denoted  by  X(t)  and 

is  the  n*n  matrix  valued  solution  of  (2.1;1)  which  corresponds  to 

u  =  0  and  X( 0 )  =  I,  X(t)  =  0  for  -h  <  x  <  0.  The  Laplace-transform 

-1 

of  X(«)  is  given  by  A  (A),  where 
A(x)  =  XI  -  L(eX’l) 

=  XI  -  f  A.e  XhJ  -  /  Ani(x)eXtdx,  A  e  <f, 
j  =  0  J  -h 

is  the  characteristic  matrix  of  (2.1;1).  Again  it  is  well  known 
that  the  forced  motion  of  (2.1:1)  (in  case  ♦  =  0)  can  be  written 

as 

t 

x(t;0,u)  =  j  X(t-x)Bnu(x)dx,  t  >  0.  (2.3) 

n  U 
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2.2.  Semigroups  and  state  space  description 

In  the  theory  of  RFDEs  two  state  space  concepts  are  of  importance 
which  are  actually  dual  to  each  other.  Existence,  uniqueness  and 
continuous  dependence  results  for  solutions  of  RFDEs  have  motivated 
the  "classical"  definition  of  the  state  of  system  (2.1)  to  be  the 
pair 


w(t)  =  (x(t),xt)  e  M2,  (2.4) 

which  completely  describes  the  past  history  of  the  solution  at 
time  t  ^  0.  The  evolution  of  this  state  is  governed  by  the 
variation-of-constants  formula 

t 

w(t)  =  S(t)$  +  /  S(t-s)Bu(s)ds,  t  ^  0,  (2.5) 

0 

which  is  the  infinite  dimensional  version  of  (2.3).  The  input 
l  2 

operator  B:  ]R  •*  M  is  given  by 

' Bu  =  (BQu, 0)  e  M2,  u  e 1R*, 

and  the  semigroup  S(»)  corresponds  to  the  free  motion  of  the 

2  2 

system,  i.e.  S(t):  M  +  M  ,  t  >  0,  is  defined  by 

S(t)*  =  (x(t:*,0),XtU,0)),  t  >  0,  4>  €  M2. 

The  infinitesimal  generator  of  S(»)  is  given  by 
dom  A  =  U  e  M2^1  e  W1*2,  *°  =  ♦1(0) > , 

i,i  (2.6) 

A$  : =  (L$  ,  $  ) , 

where  W  *  denotes  the  Sobolev  space  W  **(-h,0jIR  ).  The  function 
w(t)  as  defined  in  (2.5)  is  a  mild  solution  of  the  abstract 
system 
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w(t)  =  Aw(t)  +  Bu(t), 

(I) 

y(t)  =  Cw(t),  w(0)  =  ♦. 

O  m  0  9 

The  output  operator  C:  M  -►  K  is  defined  by  C4  =  Cq4 ,  4  €  M  . 

p 

Analogously  we  introduce  the  semigroup  S^,(  • )  on  M  which 
corresponds  to  the  transposed  system 


x(t)  =  LTxt  +  C^yU), 
u(t)  =  BpX(t). 


(2.7;1) 

(2.7;2) 


The  infinitesimal  generator  of  ST(*)  is  denoted  by  A,j.  Corresponding 
to  system  (2.7)  we  have  the  abstract  sytem 

w(t)  =  A_w(t)  +  C*y(t) 

T  (IT) 

u(t)  =  B*w(t). 

Note,  that  ST(*)  is  not  the  adjoint  semigroup  to  S(»).  The  duality 
relation  between  systems  (2.1)  and  (2.7)  involves  another  state 
concept  which  is  due  to  Miller  (3U» 


2.3«  The  dual  state  concept 

Another  state  concept  for  system  (2.1)  -  again  in  the  state 

2  2 
space  M  -  can  be  obtained  by  viewing  the  L  -component  of  the 

state  introduced  in  the  previous  section  as  an  additional 

forcing  term  instead  as  an  initial  function.  To  this  end  we  rewrite 

system  (2.1)  in  the  following  way 


x(t )  =  /  (dn(t ) ]x(t+T )  +  B0u(t)  ♦  f1(-t). 


x(0)  =  fu, 
y(t )  =  CQx(t ) , 


(2.8;l) 


(2.8;2) 
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0  1  2 

where  the  pair  f=(f,f)eM  is  given  by 


f°  .  ♦«. 

f1(o)  =  J  tdn(x) ]41(t-o) 
-h 


(2.9) 


f  A.*1(-h.-o)  ♦  J  A-  (T)^1(T-o)dx 
j=l  J  «  -h 


L  '  "i  “  '  '  J  v 

j=l  J  J  -h  U-L 

(we  define  <fr*(x)  =  0  for  x  4  t-h,0]).  Now  the  initial  state  of 

p 

system  (2.8)  is  given  by  f  €  M  .  Correspondingly  the  state  at 
time  t  >  0  is  the  pair 


z(t)  s  (x(t),xt)  e  M2, 


(2.10) 


where  xfc  e  L2(-h,0jIRn)  is  defined  by 


x*(o)  =  J  [dn(T)  ]x(t+x-o)  +  f1(o-t) 
o-t 


(2.11) 


s  ^  Ajxt("hj"o)  +  /  A  (x)x(t+x-o)dt  +  f1(o-t) 

j  =1  J  ^  J  u 

Here  for  any  solution  x(t)  of  (2.8  ;i)  we  define  xfc(x)  =  0  if 
t  >  0  or  i  <  *t.  The  state  z(t)  determines  the  future  behavior 
of  the  solution  from  t  >_  0  on,  i.e.  x(t  +  s)  =  0  for  s  >  0  if  and 
only  if  z(t)  «  0. 

The  evolution  of  z(t)  is  governed  by  the  following  variation- 
of-constants  formula 

t 

z(t)  *  S$(t)f  ♦  /  S£(t-s)Bu(s)ds,  t  >  0,  (2.12) 

1  0 

which  means  that  z(t)  is  a  mild  solution  of  the  system 


z(t)  s  A£z(t)  ♦  Bu ( t ) ,  z(0)  =  f. 


( (101,  (141,  U81).  Note  that  (r*,)  is  precisely  the  adjoint  rystem 
to  (I,p)  which  corresponds  to  the  transposed  system  (2.7)  ir.  terms 
of  the  original  state  concept.  The  operator  A*  is  the  infinitesimal 
generator  of  the  semigroup  S,£(*)  and  can  be  described  explicitly 
in  the  following  way  (see  e.g.  [ 1 8 J ) : 


Lemma  2.1.  The  operator  A|  is  given  by 

dom  A*  =  (f  e  M2|fa  +  AjAj^.b  jeW1*2,  fVh)  =  Apf 0 } , 

J  “  1  J 

(A*fl°  =  f *(0)  ♦  AQf°, 

[AJfj'Cr)  =  A01(T)f°  -  .  Y  *jf0*[-h(-hj  ]<'>'• 

The  relation  between  the  two  state  concepts  can  be  described  by 
the  socalled  structural  operator 

2  2 
F:  n  - 


p 

which  maps  every  initial  state  ♦  e  M  of  system  (z)  to  the 
corresponding  initial  state 

F$  =  f  e  M2 


of  system  (££)  which  is  given  by  (2.9).  This  operator  has  been 
introduced  by  Bernier  and  Manitius  (10).  The  adjoint  operator  F* 
is  of  the  same  form  as  F  but  with  the  transposed  matrices.  This 
means  that  F*  plays  the  same  role  for  the  description  of  the 
transposed  system  (2.7)  as  F  does  for  the  original  system  (2.1). 

The  operator  F  has  the  following  important  properties  (10J, 
(18J: 
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Theorem  2.2. 

(i)  FS(t)  =  S*(t)F,  t  >  0. 

(ii)  If  *  e  dom  A,  then  F*  e  dom  A£  and 

A*F*  =  FA*. 

(iii)  FB  =  B  and  CF  =  C. 


2.^1.  Stability,  stabilizability  and  controllability 

System  (2.1)  is  said  to  be  Atablt  if  every  solution  x(t)  of 
the  free  system  (i.e.  u(t)  =  0)  tends  to  zero  as  t  goes  to 
infinity.  Equivalently,  the  semigroup  S(*)  is  exponentially  stable, 
i.e. 


U  =  lim  i  In  | i S ( t )  ||  =  sup  {ReX  |  X  e  o(A)}  <  0 

u  t  ■+<*  ^ 

(see  for  instance  [23]).  The  spectrum  of  A  is  given  by  o(A)  = 

(X  e  $|det  A(x)  -  0}.  Note,  that  o(A,J)  =  o(A).  Clearly,  the 
stability  of  system  (2.1)  is  equivalent  to  the  stability  of  the 
transposed  system  (2.7)  and  to  the  stability  of  system  (2.8). 

The  control  system  (2.1)  is  said  to  be  Atabllizable.  if  there 
exists  a  control  law 


u(t )  =  K(x(t),xt) 


=  KQx(t) 


0 

+  J  K1  (  t  )  x(  t +  t  )dx  , 
-h  1 


(2.13) 


where  KQ  e  ]RAxn,  K^*)  e  L^(  -h,0  j3R*’xn) ,  such  that  the  closed  loop 
system  (2.1),  (2.13)  is  stable.  We  have  the  following  important 
characterization  (see  (331,(35]). 
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Theorem  2.3.  The  following  statements  are  equivalent: 

(i)  System  (2.1)  is  stabilizable. 

2  i 

(ii)  There  exists  a  K  e  L(M  ^R  )  such  that  the  operator  A  ♦  BK 
generates  an  exponentially  stable  CQ-semigroup. 

(iii)  There  exists  a  K^i  €  L(M2^R4)  such  that  the  operator  A£  ♦  BK£ 
generates  an  exponentially  stable  semigroup. 

(iv)  rank  (a(X),Bq]  =  n  for  all  X  e  with  ReX  >_  0. 

The  dual  result  is  the  following  (see  e.g.  I io 1  or  l 351*1361): 

Theorem  2.4.  The  following  statements  are  equivalent: 

—  . 

(i)  There  exists  a  H  e  LOR  ,M  )  such  that  the  operator  A +  HC 
generates  an  exponentially  stable  semigroup. 

(ii)  There  exists  a  H*  e  L0Rm>M2)  such  that  the  operator  A*  + H£C 
generates  an  exponentially  stable  semigroup. 

rA(x)> 

(iii)  rank  =  n  for  all  X  e  $  with  Rex  >  0. 

C0 

« 

System (2.1)  is  called  detectable  if  the  statements  of  the  previous 
theorem  are  satisfied.  A  detailed  discussion  of  the  perturbed 
semigroups  and  the  duality  relations  between  feedback  stabilization 
and  dynamic  observation  in  the  product  space  framework  can  be 
found  in  (  35  J . 

System  (2.1)  is  called  approximately  controllable,  if  the 
reachable  subspace 

t  ?  . 

R  =  {/  S(t-s)Bu(s)ds  |  t  >  0,  u(»)  €  IT(0,tilR  )} 

0 

2 

in  dense  in  M  ;  it  is  called  strictly  observable  if  for  all 
solutions  of  (2.1)  y(t)  =  0,  t  _>  0,  implies  x(t)  *  0,  t  ^  -h. 

These  two  properties  have  been  characterized  by  Manitius  (271,(28] 
as  follows. 
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Theorem  2.5.  Let  Aq1(t)  s  0.  Then  system  (2.1)  is  approximately 
controllable  if  and  only  if  the  following  conditions  are 
satisfied: 

rank  tA(x),BQl  >  n  for  all  x  « 
rank  [ Ap,BQ ]  =  n. 

System  (2.1)  is  strictly  observable  if  and  only  if  the  following 
conditions  are  satisfied: 

fA(X)>| 

rank  =  n  for  all  x  e 


rank  A.  =  n. 
P 
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3.  The  linear  quadratic  control  problem 

3.1.  Control  systems  in  Hilbert  spaces 

Let  us  first  deal  with  general  linear  control  systems  in 
Hilbert  spaces  X,  U  and  V  described  by 


x(t)  *  Ax(t )  +  8u(t),  x(0)  =  Xq , 

y (t )  =  Cx(t ) . 


(3.1) 


We  assume  that  8  e  L(ll,X),  C  e  L(X,y)  and  that  A  is  the 
infinitesimal  generator  of  a  CQ-semigroup  S(t)  on  X.  System  (3.1) 
will  be  unterstood  in  the  sense  of  mild  solutions,  i.e.  the 
trajectories  of  the  system  are  given  by 

t 

x(t)  =  S(t)x  +  /  S(t-s)8u(s)ds,  t  >  0,  (3-2) 

u  0 

2 

for  any  xQ  e  X  and  any  input  u(»)  e  Lioc (0,«;U) . 

Let  R:  U  -*■  U  and  G:  X  ■*  X  be  self  ad  joint  linear  operators 
satisfying 


<x,Gx>  ^  0  for  all  x  e  X 


and 


<u,Ru>  >  e  ||  u  ||  ^  for  all  u  e  U 

with  some  e  >0.  In  this  section  we  look  at  the  control  problem 
of  minimizing  the  cost  functional 

J(u)  =  <x(T) ,Gx(T) >  + 

T  o 

♦  J  l  ||Cx(t)|l<i  +  <u(t)  ,Ru(t)>  ]dt, 

0 


(3.3) 


where  x(t)  is  given  by  (3.2)  and  T  >  0  is  a  fixed  final  time. 
The  following  result  has  been  proved  in  [151: 


Theorem  3.1.  For  any  xn  e  X  there  exists  a  unique  control 
___________  u 

function  u(*)  e  L  (0,T;U)  which  minimizes  the  cost  functional 
(3.3)  under  the  contraint  (3.2).  The  optimal  control  is  of 
feedback  form  and  is  given  by 

u(t)  =  -R_1B*P(t)x(t),  t  >  0  (3.4) 

where  7(t)  is  the  mild  solution  of  the  Cauchy  problem 
x  =  (A- SR  18*P(t))x,  x(0)  =  Xq,  and  t  -*•  P(t)  e  L(X)  is  the  unique 
operator  valued  function  on  [0,T]  with  the  following  properties: 

(i)  P(t)  is  positive  semidefinite  for  every  t  e  [0,TJ. 

(ii)  The  function  t  ■*  P(t)x  is  continuous  on  10,T]  for  every  x  e  X. 

(iii)  The  function  t  -*•  <x,P(t)tf  is  continously  differentiable  on 
[  0  ,T  ]  for  all  x,y  e  dom  A  and  satisfies  the  Riccati 
differential  equation 

^  <y,P(t)x>  +  <Ay,P(t)x>  +  <P(t)j/,Ax> 

-  <y,P(t)BR_1B*P(t)x>  +  <C y,Cx>  =  0,  (3.5.1) 

<y,P(T)x>  =  <ytGx> .  (3.5;2) 

Moreover,  the  optimal  cost  is  given  by 

J(u)  =  <x0,P(0)xQ>. 

It  is  easy  to  see  (cf.  (20])  that  equations  ( 3 • 5 )  can  be 
written  in  the  form 


P(t)x  =  S*(T-t)6S(T-t)x 
T 

+  /  S*(t-t)(C*C 
t 


(3.6) 

P(i)6R*1S*P(T)]S(T-t)xdT, 


0  <  t  <  T,  *  e  X,  or  respectively. 


P(t)x  =  S* (T-t )G*(T,t ) x 
T 

+  /  S*(T-t)C*C*(T,t)XClT, 
t 


(3.7) 


0  <  t  <  T,  x  e  X,  where  *(i,t)  is  the  evolution  operator  given  by 

T 

♦  (T,t)x  =  S(T-t)x  -  /  S(t-o)BR  o*P(o)*(o,t) xdo > 

*  (3.8) 

0  i  t  i  T  i  x  €  X. 

Let  us  now  consider  the  problem  of  minimizing  the  cost 
functional 


J(u)  =  J  l  J|  Cx(t )  || 2  +  <u(t)  ,Ru(t)>  ]dt  (3.9) 

0 

where  again  x(t)  is  given  by  (3.2).  For  this  situation  the 
following  result  has  been  proved  (see  [ 15  ] , 1 16  ] ,  [ 4l  ] ;  further 
references  can  be  found  in  the  survey  paper  [91): 


Theorem  3.2.  a)  The  following  statements  are  equivalent: 

2 

(i)  For  any  xQ  e  X  there  exists  an  input  u(«)  e  L  (0,«*;U)  such 
that  the  corresponding  cost  J(u)  given  by  (3-9)  and  (3.2) 
is  finite. 

(ii)  There  exists  a  positive  semidefinite  operator  P  e  L(X) 
satisfying  the  algebraic  Riccati  operator  equation 


<Ay,Px>  +  <P«/,Ax>  ♦  <Ct/,Cx> 
-  <Pj/,8R-18*Px>  =  0 


(3.10) 


for  all  x,  y  e  dom  A. 

b)  If  the  statements  under  a)  are  valid,  then  there  exists  a 
unique  optimal  control  u(t)  which  is  given  by  the  feedback  law 


(3.11) 


u(t)  =  -  R“1B*Px(t),  t  >0, 

where  x(t)  is  the  mild  solution  of  the  Cauchy  problem 
x  =  (A-8R  16*P)x,  x(0)  =  Xq,  and  P  is  the  minimal  solution 

of  (3.10).  Moreover,  the  optimal  cost  is  given  by 

J(u)  =  <xQ,Px0>. 

c)  Suppose  that  the  statements  under  a)  are  satisfied  and  let  P 
be  the  minimal  positive  semidefinite  solution  of  (3-10).  Moreover, 
let  P,p(t),  0  <  t  _<  T,  be  the  unique  positive  semidefinite  solution 
of  (3.5 »1)  with  Pt(T)  =  0.  Then  P  is  the  strong  limit  of  PT(0)  as 
T  goes  to  infinity. 

d)  Suppose  that  there  exists  some  H  e  L(V,X)  such  that  the  operator 
A  ♦  HC  generates  an  exponentially  stable  semigroup.  Then  there  exists 
at  most  one  positive  semidefinite  solution  of  (3.10).  Moreover, 

if  such  a  solution  exists,  then  the  closed  loop  semigroup  generated 
by  A-8R”18*P  is  exponentially  stable. 

Finally  note  that  any  solution  P  of  the  algebraic  Riccati  equation 
is  a  stationary  solution  of  the  Riccati  differential  equation.  Hence 
it  follows  from  (3.6),  (3.7)  and  (3.8)  with  G  =  P  that  the  algebraic 
Riccati  equation  (3.10)  is  equivalent  to 

Px  *  S*(t)PS(t)x 

t  . 

♦  J  S*(t)[C*C  -  PBR  18*P]S(x)xdx, 

0 

t  >  0,  x  e  X,  or,  respectively,  to 

t 

Px  *  S*(t)PS„ (t)x  +  /  S* ( x )C*CS0 ( x )xdx ,  (3.12) 

p  0  p 

t  >  0,  x  e  X,  where  Sp(»)  is  the  closed  loop  semigroup  generated 

by  A  -  8R”18*P. 
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3.2.  Applications  to  hereditary  systems 

Let  us  first  apply  Theorem  3.1  to  the  systems  (I)  and  (i£v 
which  are  associated  to  the  system  (2.1)  in  terms  of  the  two 
state  concepts  introduced  in  Section  2.  The  cost  functional  for 
system  (2.1)  is  given  by 


J(u) 


x(T;4»,u)TG0x(T;<j>,u) 

T 

+  /  (  ||C_x(t;4>,u)  j|2  +  u(t)TRu(t) ]dt, 
0  u 


(3.13) 


where  ReTR*  1  is  positive  definite  and  G0  e]Rn  n  is  positive  semidefimte . 

2  2  u  o  2 

The  operator  G:  M  -*•  M  is  defined  by  G$  =  (Gq$  ,0),  $  e  M  .  Then 
the  cost  functional  for  systems  ( £ )  and  (£*)  is  given  by  (3.3) 

(with  G  :  G,  C  =  C  and  R  =  R,  of  course).  According  to  Theorem  3.1 
there  exist  two  unique,  positive  semidefinite,  strongly  continuous 

p 

families  n ( - )  and  P(*)  of  operators  in  L(M  )  which  satisfy  the 
following  Riccati  differential  equations: 


^  «l>,n(t)4>>  +  <A<|i,n(t )$>  +  <n(t)ij>,A$> 

(3.1*0 

-  <n(t)ij/,BR''1B*n(t)^>  +  <c*,c*>  s  o. 


n(T)  =  G, 


♦  e  dom  A,  0  t  T,  and,  respectively. 


<g,P(t)f>  +  <A*g,P(t)f>  +  <P(t)g,A*f> 
-  <P(t)g,BP_1B*P(t)f>  +  <Cg,Cf>  =  0, 


(3.15) 


P(T)  =  G, 


f,g  e  dom  A^,  0  <  t  <  T. 

The  operators  n(t)  and  P(t)  have  the  following  properties: 
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Proposition  3.3.  a)  n(t)  =  F*P(t)F,  0  _<  t  _<  T. 

b)  range  P(t)  c  dom  AT  for  every  t  <  T-h.  If  GQ  =  0,  then  range 
P(t)  c  dom  At  for  every  t  e  (0,T1.  Moreover,  in  this  case  the 
function  t  -*•  P(t)f  is  continuously  differentiable  on  (0,T] 
for  every  f  e  dom  A*,  and  satisfies 

P(t)f  +  A_P(t ) f  +  P(t )A*f  - 

dt  T  T  (3.16) 

-  P(t )BR*1B*P(t ) f  +  C*Cf  =  0, 

P(T)  =  0. 

c)  range  n(t)  c  dom  A*  for  every  t  <  T-h.  If  G0  =  0,  then 
range  n(t)  c  dom  A*  for  every  t  e  [0,T].  Moreover,  in  this  case 
the  function  t  -*■  n(t)<fr  for  every  <fr  e  dom  A  is  continuously 
differentiable  on  [0,T]  and  satisfies 

4t-  n(t)*  +  A*n(t  )$  -  it(t)A*  - 

dt  (3.17) 

-  n(t)BR_1B*n(t)*  +  c*c^  =  o, 

n(T)  =  o. 

Proof,  a)  has  been  shown  in  [171.  However,  it  also  follows 
immediately  from  Theorem  2.2  that  n(t)  =  F*P(t)F  defines  a 
positive  semidefinite  solution  of  (3.1*0  if  P(t)  is  a  positive 
semidefinite  solution  of  (3.15) • 

b)  follows  from  (3*7)  and  (3.8)  with  P(t)  =  P(t),  S(t)  =  S,J(t), 

8  =  B,  C  =  C  and  R=  R.  One  has  to  observe  the  following  facts: 

(i)  range  ST(t)  c  dom  AT  for  all  t  >  h. 

t  p 

(ii)  /  S_(s)C*u(s)ds  e  dom  A-,  for  all  u  e  IT (0,T HR1) . 

0  1  1 

o 

(iii)  If  z(s,t)  e  M  is  continuous  on  {(s,t)  I  0  <  t  <  s  _<  T) 
and  continuously  differentiable  in  the  second  variable, 
then  the  function 
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T 

w(t)  =  j  S„,(s-t)z(s,t)ds,  0  _<  t  _<  T, 

t  1 

is  continuously  differentiable  and  satisfies 

T 

~  w(t)  =  -  ATw(t)  +  |  ST(t-s)  ~L  z(s,t)ds  -  z(t,t). 


c)  follows  from  a),  b)  and  Theorem  2.2  a 


Let  us  now  look  at  the  structure  of  the  operators  n(t)  and  P(t). 

2 

Due  to  the  product  space  structure  of  the  state  space  M  we  can 
write 


n(t ) 


p 

o 

o 

n01(t)  ■ 

'  poo(t> 

p0!(t>  ■ 

,  P(t)  = 

o 

ct 

w 

"n(t>  • 

.  P10U) 

pu(t>  . 

where  nQ0(t),  P0Q(t)  are  self>adj0int  operators  ]Rn  -*■  ]Rn  which  can 
be  represented  by  symmetric  matrices  and  Ji^lt),  P^Ct)  are 
selfadjoint  operators  L2  -*  L2 .  The  operators  Ji1Q(t),  P1Q(t)  can 
be  represented  by  matrix-valued  functions  ni0(t,,)»  p10(t»*)  € 
L2(-h,0jEn  n).  The  adjoint  operators  nQ1(t)  =  ni0^t^  and  P01^  = 
P*Q(t)  from  L2  -*•  ]Rn  are  given  by 

0  m  0  rp 

n01<t)«  =  /  n^0(t,T)$(t)dT,  P01(t)#  =  /  P10(t,T)*(t)dT, 

Jj'  -h  -h 


We  are  mainly  interested  in  the  matrices  n^Ct)  and  Ji10(t,t)  which 
determine  the  optimal  feedback  law 

u(t)  =  -  R_1BQ(n00(t)x(t)  +  J  n^0(t,x)x(t+T)dT J  (3.18) 

u  -h 

2  TO  l 

for  system  (2.1).  Recall  that  B*  maps  $  e  M  to  Bq$  e  3R  .  By 
Proposition  3.3,  a)  we  have  the  following  relations  between  n(t) 
and  P ( t ) : 


20 


(3.19) 


noo(t)  =  P00(t)' 


n10(t,o)  = 


X  Ajpio(t»"hj'< 


o)  +  jAg1(T)P10(t,T-o)dT. 


Hence  the  control  law  (3.18)  can  be  written  in  the  form 


u(t)  =  -  R”*Bq lPQ0(t)x(t)  ♦  f  /  P^0(t,-h.-o)Aj: 

j=!  - h . 


P:n(t,-h.-o)A.x(t+o)do 


+  /  /  P^0(t,T-o)A-  (T)x(t+o)dodr . 


(3.20) 


-h  t 


Finally,  note  that  P  Q(t,*)  e  W1,2(-h,0;2Rnxn)  and  PQ(J(t)  =  P1Q(t,0) 
for  t  _<  T-h  for  all  t  e  [0,Tl  provided  that  GQ  =  0  (Proposition  3*3, b)) 

For  the  rest  of  this  section  we  assume  that  system  (2.1)  is 

stabilizable  and  detectable,  so  that  systems  ( E )  and  (£*)  satisfy 

the  assumptions  of  Theorem  3.2.  Hence  there  exist  positive  semi- 

2 

definite  operators  n,  P  e  L(M  )  satisfying  the  algebraic  Riccati 
equations 


A*n*  +  11A+  -  nBR~1B*n«  +  C*C*  =  0, 


(3.21) 


+  €  dom  A,  and,  respectively. 


ATPf  ♦  PA*f  -  PBR  AB*Pf  +  C*Cf  =  0, 


(3.22) 


f  e  dom  A^.  The  equations  can  be  written  in  this  form  since  every 
solution  P  of  (3.10)  maps  dom  A  into  dom  A*.  The  relation  between 
n  and  P  is  as  follows: 


Proposition  3.4.  a)  n  =  F*PF. 

b)  range  P  c  dom  A^,. 

c)  range  II  c  dom  A* . 
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Proof.  Statement  a)  follows  again  from  the  fact  that  for  any 
solution  P  of  (3.22)  the  operator  n  =  F*PF  defines  a  solution  of 
(3.21)  (see  also  (401  ).  Moreover,  b)  follows  from  (3.12) 

(for  t  ^  h)  and  c)  follows  from  a),  b)  and  Theorem  2.2  o 

Again  the  operators  n  and  P  can  be  written  in  block  form 


■  "oo 

n01 

p 

00 

P01  ■ 

n  = 

) 

P  = 

nn 

11 

.  Pio 

P11 . 

0 

where  =  n*Q  and  PQ1  =  P*Q  map  L  into  IR  .  By  Proposition  3-4 
we  have  P1Q(»)  6  (-h,0 jIRnXn)  and 


n00  =  p00  =  P10(0)» 


(3.23) 


nio(o)  =  Ajpi0('hj'o)  Aoi(,)pio(,-°)<lT- 

Hence  the  optimal  feedback  law  is  of  the  form 


u(t)  =  -  R"1B*n(x(t),xfc)  =  -  R_1B*PF(x(t),xt) 

=  -  R_1BQ(n00x(t)  +  Jn^0(T)x(t+x)dT)  (3.24) 

j  -ji 

=  -  R_1BQ[P10(0)x(t)  +  \  J  Pi0(“hJ.-o)Aj.x(t+o)dc 

j  = 1  ~h . 

00  „ 


+  j  J  Pj0(T-o)A01(T)x(t+o)dodx ) . 

Finally  note  that  the  closed  loop  system  (2.1),  (3.24)  is  stable 
(Theorem  3.2). 
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'  I 


4.  Approximation 
4.1.  A  general  scheme 


In  this  section  we  present  a  general  approximation  scheme  for 
linear  abstract  Cauchy  problems  restricting  ourselves  to  a 
situation  which  is  of  sufficient  generality  for  our  purposes. 

Let  X  be  a  real  Banach  space  with  norm  ||  •  ||  .  Furthermore 
let  A  be  the  infinitesimal  generator  of  the  C^-semigroup 
S(t),  t  >  0 ,  on  X.  It  is  well  known  (see  for  instance  [30], 
p.  278,  or  [32],  p.  100)  that  x(t)  =  S(t)xQ  for  any  x^  e  dom  A 
is  the  unique  strong  solution  of  the  abstract  Cauchy  problem 


x(t)  a  Ax(t ) ,  t  >_  0, 
x(0)  a  XQ. 


(4.1) 


By  a  strong  solution  x(t)  a  x(t;xQ)  of  (4.1)  we  mean  a  continuously 
differentiable  function  x:  [0,«)  •+  X  such  that  x(t)  e  dom  A  for 
t  0  and  (4.1)  is  satisfied.  There  exist  constants  M  ^  1  and 
u  e  K  such  that 


||S(t)||  <  Meut,  t  >  0. 


Our  goal  is  to  approximate  the  trajectories  S(t)Xg,  xQ  e  X  , 

by  sequences  of  solutions  to  Cauchy  problems  in  finite  dimensional 

N 

spaces.  It  is  a  standard  idea  to  choose  a  sequence  (X  }  of  finite 
dimensional  subspaces  of  X  with  corresponding  projections 

pN:  X  •*.  XN,  N  =  1,2,...  , 

N 

and  to  define  (in  an  appropriate  way)  a  sequence  (A  }  of  linear 
operators 


A 


N 


,N 


» 


N 


1,2, 


N 

With  A  and  x^  e  X  we  associate  the  Cauchy  problem 


xN(t)  =  ANxN(t),  t  >  0 
xN(0)  =  pNxQ, 


(4.2) 


on  XN.  We  extend  the  definition  of  A^to  all  of  X  by  A^x  =  ANpNx 

N 

and  define  the  CQ-semigroup  S  (t),  t  >  0,  on  X  by 


SN(t)xQ  =  e*  txQ  =  e*  fcpNXQ  +  xQ  -  pNXg,  1  1  xQ  e  X. 


The  following  hypotheses  will  be  used  in  order  to  guarantee 
the  desired  convergence  SN(t)pNxQ  •*  S(t)xQ: 

(HI)  lim  pNx  =  x  for  all  x  e  X. 

N-*« 

(H2)  There  exist  constants  M  ^  1  and  w  e  ]R  such  that 

||SN<t)x|l  <  M«"ti|*!| 

N 

for  all  t  >  0,  x  e  X  and  N  =  1,2,...  . 

(H3)  There  exists  a  dense  subset  D  c  dom  A  which  is  invariant 
with  respect  to  S(t),  t  _>  0,  such  that 

(i)  lim  ANpNx  =  Ax  for  all  x  e  D 
N-*~ 

and 

(ii)  for  any  x  e  D  there  exists  a  function  m(*,x)  e  L^oc ( 0 , • flR ) 
such  that 

|| ANpNS(t)x||  _<  m(t;x)  a.e.  on  (0,») 
for  all  N. 

Hypothesis  (H2)  is  equivalent  to 
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(H2*)  For  any  N  there  exists  a  norm  11*11  N  on  such  that 

(i)  for  some  constant  M  >  1 

11*11  1  ll*llN  1  M||«||,  x  e  X\  N  =  1,2,..., 

and 

(ii)  for  some  constant  u  e  TR  all  operators  A  -  ul  are 
dissipative  on  (XN,j|«j|N),  i.e.  (cf.  (32]»Thm.  4.2) 

H(AN-uI)x||n  >(w- 

M 

for  all  x  e  X  and  all  w  >  u . 

If  (H2)  is  satisfied  we  define 

IML  =  sup  HSN(t)x||e‘ut,  x  e  XN,  N  =  1,2,...  . 
t>0 

It  is  easy  to  see  that  ||«||N  is  a  norm  on  XN  with 

11*11  ill*llN  I  M |!x||,  x  e  XN,  N  *  1,2,...  . 

Moreover  for  the  operator  norm  corresponding  to  ll*llN  we  have 
H5N(t)llN  <  e5t,  t  >  0,  N  =  1,2,...  . 

Then  (H2*,ii)  is  an  immediate  consequence  (cf.(3?J,  Thm.  4.3). 
Conversely,  if  (H2*)  is  valid  then  by  (H2*,ii)  we  get 

l|SN(t)||N  <  ewt,  t  >  0,  N  =  1,2,...  . 

Using  (H2*,i)  we  immediately  get  (H2). 
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We  note  some  consequences  of  (HI)  -  (H3)  which  will  be  useful 

for  the  proof  or  our  convergence  result: 

N 

a)  The  projections  p  are  uniformly  bounded,  i.e.  there  exists 
a  constant  y  >  0  such  that 

Up  I!  <  n  =  1,2,...  . 

b)  If  x:  (0,T1  -*•  X,  T  >  0,  is  continuous  then 

lim  pNx(t)  =  x(t) 

N-- 

uniformly  for  te  10,T]. 

Assertion  a)  follows  from  the  uniform  boundedness  principle. 

If  b)  were  not  true,  we  could  deduce  the  existence  of  a  monotone 
sequence  N,  -»■  •  and  a  sequence  (t.  }  in  [0,T]  with  t  t  e  [0,T] 

K  at  K  K  U 

such  that  |jp  kx(t.  )  -  x(t.  )  ||  >  a  >  0  for  all  k.  Using  continuity 

K  K  m 

of  x  we  immediately  would  get  a  contradiction  to  p  x(tQ)  x(tQ). 

Theorem  4.1.  Let  (HI)  -  (H3)  be  satisfied  for  the  sequences  X**, 
p^,  AN,  N  s  1,2,...  .  Then  for  all  xQ  e  X 

lim  e^tpNxn  =  S(t)x0  (4.3) 

N-*-«  u  u 

uniformly  for  t  in  bounded  intervals. 

Proof.  We  first  choose  xQ  e  D  and  put 

AN(t)  =  pNx(t)  -  xN(t),  t  >  0,  N  =  1,2...  , 

where  x(t)  *  x(t;x^)  and  x^(t)  =  xN(t;pNxQ)  are  the  solutions  of 
(4,1)  and  (4.2),  respectively.  Since  the  derivative  of  AN(t) 
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exists  for  all  t  >  0,  the  left-hand  derivative  ^r||AN(t)||N 
exists  for  all  t  >  0  and  is  given  by  ((301,  p.  22 8) 

iuN(t) nN  =  T_uN(t),£N(t)),  t  >  o, 

A 

where  t  (x,y)  =  lim  -(II  x  +  ry  |L  - 1|  x  |L  ). 

t-KT  t  n  n 

Using  (4.1),  (4.2)  and  the  estimates  t_(x,i/1  ♦  y~)  <_  t_(x,j/^)  + 

♦  *+u»{/2)  and  lT+(x*y)l  <\\y\\Hi  we  get 

|FIUN(t)HN=  rjAN(t),pNAx(t)  -  ANxN(t)) 

=  tjAN(t),pNAx(t)  -  ANpNx(t)  ♦  AV(t)) 

«  My||Ax(t)  -  ANpNx(t )  }|  +  T_UN(t),ANAN(t)), 

t  >  0. 

By  (H2*,ii)  we  have  t_(AN(t )  ,ANAN(t) )  _<  u>||AN(t)||N  for  all  N 
(see  for  instance  [30],  p.  244).  Therefore  for  y  =  My 


fFiuN(t)iiN<;iiAN(t)iiN  +;iiaxu)  -  ANPNx(t)ii,  t  >  o, 

which  implies 


||AN(t)||  <  ||AN(t)||N 

t  (4-4) 

*  Y  j  II  Ax(t)  -  AKpJ<x(T)|j  e“*t"T^dT,  t  >  0. 

0 


-27- 


for  all  N.  Since  D  is  invariant  with  respect  to  S(t)  we  have 
x( t )  =  S(t)Xq  e  D  for  t  >  0.  By  (H3)  we  can  use  Lebesgue's 
dominated  convergence  theorem  in  order  to  get 

lim  aN(t)  =  0 
N-+-® 

uniformly  for  t  in  bounded  intervals  provided  xQ  e  D.  The  estimate 
||x(t)  -  xN(t)  ||  <  ||  x(t )  -  pNx(t )  jj  +  ||  &N(t )  ||  together  with  b)  from 
above  proves 

lim  eA  fcpNxn  =  S(t)xn 
N-*"»  u  u 

uniformly  for  t  in  bounded  intervals  for  all  x^  e  D. 

For  arbitrary  we  choose  a  sequence  {xnl  in  D  with  xn  ■+  Xq. 

Then  the  estimate 

|l  x(t  5  xQ)  -  xN(t;pNxQ)  |i  ||  x(t  ;x0)  -  x(tsxn)|| 

+  1 1  x  ( t  i  xn )  -  xN(t;pNxn)||  +  ||xN(t;pNxn)  -  xN(t;pNx0)j| 

<  (Meut  +  Meu,t)||  xQ  -  xN  ||  +  ||x(t;xn)  -  xN(t;pNxN)i| 

proves  (4.3)  for  all  xQ  e  X  o 

The  methods  in  the  proof  of  the  previous  theorem  are  well  known 
in  connection  with  numerical  approximation  of  partial  differential 
equations  (see  for  instance  the  proof  of  the  Lax-Richtmyer 
equivalence  theorem  in  (221).  For  delay  equations  this  approach 
appears  for  the  first  time  in  .{  31  »  (61  and  has  later  on  been  used 
in  (251.  We  consider  the  more  general  Benach  space  situation, 
because  the  proof  is  almost  the  same  as  in  the  Hilbert  space  case. 
We  equally  well  could  have  used  the  Trotter  Kato  theorem  (321.  We 
choose  the  classical  Lax-Richtmyer  idea,  because  with  minor 
modifications  the  above  proof  also  applies  to  the  case  of  time 
varying  coefficients. 


Next  we  consider  the  nonhomo geneous  problem 


x ( t )  =  Ax(t)  +  8u(t),  t  >  3,  (4.5*1) 

x(  s )  =  Xq  €  X ,  ( 4 . 5 ; 2 ) 

where  u  e  L?  and  8  is  a  linear  operator  -►  X. 

loo 

The  unique  mild  solution  x(t)  =  x(t;s,Xg,u)  of  (4.5)  is  given 
by 

t 

x(t)  *  S(t-s)x  +  J  S(t-t)8u(T)dr,  t  >  s.  (4.6) 

u  s 

M  n  N 

In  addition  to  the  approximating  sequence  X  ,  p  ,  A  ,  N  =  1,2,..., 

N 

introduced  above  let  us  assume  that  B  ,  N  =  1,2,...,  is  a 

£  N 

sequence  of  corresponding  input  operators  ]R  -►  X  .  Then  we 
consider  the  approximating  systems 

xN(t)  =  ANxN(t)  ♦  8Nu(t),  t  >  s,  (4.7  ;1) 

xN(s)  =  pNxQ,  xq  e  X,  (4.7*2) 

N  N  N  N 

on  X  with  the  unique  solution  x.  (t)  =  x  (t;s,p  xQ,u)  given  by 

xN(t)  =  SN(t-s)pNxQ  +  /  SN(t-T)8Nu(t)dT,  t  >  s,  (4.8) 

u  s 

u 

where  S  (t):  X  -*■  X  is  defined  as  above. 

The  following  theorem  and  its  proof  are  a  slight  modification 
of  a  result  already  established  in  [  4  } . 

u 

Theorem  4.2.  Assume  that  S  (•),  N  =  1,2,...,  and  S(*)  are 
Cg-semigroups  on  X  such  that  for  constants  M  _>  1,  «  e3R 

ljSN(t)||  <  Me"fc,  t  >  0,  N  *  1,2,...,  (4.9) 

and  for  all  xQ  c  X 
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(4.10) 


lint  SN(t)pNxn  =  S(t)xn 


uniformly  on  bounded  t-intervals.  Furthermore  assume  that 


lira  BNc  =  8t  for  all  C  eB1.  (4.11) 

N-*-« 


Then  for  all  xQ  e  X  and  T  > 
lim  xN(t ;s ,pNxQ ,u) 
uniformly  for  0  <  s  <  t  <  T 

IMI  2  "* 

IT(s,  T  ,K  ) 


0 

=  x(t ;s ,Xq,u) 

and  for  u  e  L^(s,  T  3R*)  with 


Proof.  By  (4.9),  (4.10)  and  (4.11)  we  have  SN(t)BN£  ♦  S(t)Be 
for  all  £  e  IR*  uniformly  for  te  [0,TJ  (note,  that  (4.10)  implies 
p  I  strongly)  which  shows 

||SN(t)BN  -  S  ( t )  8  1 1  -  0 

uniformly  for  t  e  [0,T]  .  By  (4.9)  and  an  application  of  the 
dominated  convergence  theorem  we  get 

T 

|  ||SN(t)8N  -  S(t)8|(2dt  -  0. 

Then  the  result  follows  from 

||x(tis,x0,u)  -  xN(t;s,pNx0,u)|| 

<||S(t-s)xQ  -  SN(t-s)pNx  ||  +  /||S(t-t)8- SN(  t-T  )BN  ||  |u(T)|dt 
-  a 

<||S(t-s)x0-SN(t-s)pNx0||  ♦ 

T 

♦  (/  ||S(t)8- SN(t)8N||2  dt)1/2|lu||  ?  o 

0  L^(s, T  ) 
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4.2.  Approximation  of  the  feedback  law 

Throughout  this  section  we  assume  that  X  is  a  Hilbert  space. 
We  restrict  ourselves  to  the  finite  time  control  problem  of 
minimizing  the  cost  functional 


JS(U) 


<x(T),G*(T)> 

T 

♦  )  (||Cx(t)||2  +  u(t)TRu(t)]dt 
s 


(4.12) 


associated  with  the  Cauchy  problem  (4.5).  We  assume  that  the 
operators  G:  X  -*>  X  ,  R:  2R*  ■+2R*’,  C:  X  3Rm  are  defined  as  in 
Section  3.1.  As  we  have  seen  in  that  section  (with  obvious 
modifications  for  the  case  when  the  initial  time  s  is  not  necessarily 
zero),  the  unique  solution  of  this  problem  is  given  by  the  feedback 
law 


ug(t)  =  -R"1B*P(t)*(t,s)x0,  s  <  t  <  T,  (4.13) 

where  P(t):  X  X  is  the  unique  positive  semidefinite  solution  of 
the  Riccati  differential  equation  (3.5)  and  *(t,s)  is  given  by 
(3.8). 


Correspondingly,  we  consider  the  sequence  of  control  problems 
of  minimizing 


(u) 


<xN(T),GxN(T)> 

T 

+  /  (  ||CxN(t)||2  +  u(t)TRu(t))dt 

s 


(4.14) 


N  N  N 

where  x  (t)  *  x  (tjs,p  xQ,u)  is  the  unique  solution  of  (4.7). 
The  optimal  control  is  given  by  the  feedback  law 


Sj(t) 


-R‘1(8N)*PN(t)/(t,s)pNx0 
-R  ‘1(8N)*PN(t)«N(t,s)x0,  s  <  t  <  T, 
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Note  that  these  two  facts  justify  the  second  equation  in  (4.15). 
Moreover,  the  optimal  cost  of  (4.14),  (4.7)  is  given  by 

jJJCuJ)  =  <x0,PN(s)x0>.  (4.20) 

We  remark  that  PN(t),  regarded  as  an  operator  on  XN,  satisfies 
the  following  finite  dimensional  Riccati  differential  equation 
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^  PN(t)  +  (AN)*PN(t)  ♦  PN(t)AN 


-  PN(t)BNR"1(BN)*PN(t)  +  pNC*CpN  =0,  t  <  T,  (4.21) 


PN(T)  =  pNGpN. 


Obviously,  the  most  interesting  question  is  how  the  original 
system  (4.5)  behaves  when  the  optimal  feedback  control  (4.13) 
is  replaced  by  the  approximate  control  law 


Ug(t)  =  - R '1(8N)*PN(t)iN(t,s)x0 


(4.22) 


where  *w(t,s)  denotes  the  corresponding  closed  loop  evolution 
operator  on  X  and  is  defined  by 


*  (t,s)x  =  S(t-s)x 


-  /  S(t-T)BR"1(8N)*PN(T)*N(T,s)xdT 


(4.23) 


for  x  e  X  and  s  <_  t  <  T.  All  the  desired  convergence  results  are 
contained  in  the  next  theorem  which  is  a  straight  forward 
consequence  of  Theorems 6.1  -  6.3  in  (211.  For  the  convenience  of 
the  reader  we  present  the  main  ideas  of  the  proof. 

Theorem  4.3.  Let  us  assume  that 

(i)  there  exist  constants  M  >  1,  u  e  K  such  that 

||SN(t)||  <  Mewt,  t  >  0,  N  =  1,2,..., 

(ii)  for  every  x  e  X 


lim  SN(t)pNx  =  S(t)x,  lim  SN(t)*pN*  =  S(t)*x 
uniformly  on  (0,T)  and 
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(iii ) 

lim 

=  85 

i 

for  every  c  e  1R  . 

N-*'® 

Then, 

for  every 

xo  6 

X  , 

(a) 

lim 

= 

lim 

J  (u”)  =  J  (««>. 

N-*® 

s  s 

N-*® 

s  s  s  s 

(b) 

lim 

ns(t)  = 

lim 

N-*-® 

u^(t)  =  u  (t), 
s  s 

(c) 

lim 

4>N(t  ,s )  x 

n 

lim  $N(t,s)xn  =  *(t,s)xn. 

N-*® 

PN(s)x0 

u 

N-»®  U 

(d) 

lim 

N-*-® 

=  p( 

s)xQ 

and  the  limits  are  uniform  on  the  domain  0_<s<^t_<T.  If 
6:  X  -*■  X  is  a  finite  dimensional  operator,  then  PN(s)  converges 
to  P(s)  in  the  uniform  operator  topology,  uniformly  on  the  interval 
10, T) . 

2  l 

Proof.  Let  us  introduce  the  operators  Fs(t):  L  (s,TjIR  )  X, 

G  :  X  -  L2(s,TjlRi),  R  :  L2(s,Tj3Ri)  L2(s,T;IR*)  by 

3  S 

defining 

t 

Fs(t)u  =  /  S(t-T ) 8u( r )dt , 

T 

G  x  =  F  (T) *GS (T-s ) x  +  f  F  (  t  )  *C*CS ( t-s ) xdi ,  (4.24) 

SS  _  S 

S 

T 

R  u  =  F  (T)*GF  (T)u  +  f  F  ( t ) *C*CF  (r)udx  +  Ru 
s  s  s  *  s  s 

3 

2  £ 

for  u  e  L  (s,TjIR  )  and  x  e  X.  Of  course,  Ru  is  defined  by  (Ru)(t)  = 

Ru(t),  s  t  _<  T.  Then  it  is  easy  to  see  that  the  Frechet  derivative 

of  J  with  respect  to  u  is  given  by  J'(u)  =  2R  u  +  2G  x  .  Since  the 
s  ^  _  s  s  s  u 

optimal  control  u  satisfies  J'(u  )  =  0,  this  implies 

S  SB 

*  -*;Vo-  <*•«> 

Analogously,  we  get 
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(4.26) 


-N  . PN  v-lpN  N y  . 
us  *  *  <V  V  X0  = 


"  (Rs)'lGsX0 


where  R^,  G^,  are  defined  as  above  with  S(t),  8,  C,  G 
replaced  by  SN(t),  SN,  Cp1^,  p^GpN,  respectively.  Combining  these 
formulae  with  (3.8),  (4.13)  and  (4.17),  (4.15),  we  get 


*(t,s)x0  =  S(t-s) xQ  -  Fa(t)RslGsx0*  (4.27) 

*N(t,s)x0  =  SN(t-s)x0  -  Pg(t)(R^)“1G”x0  (4.28) 


for  every  s  e  [0,T]  and  every  t  e  [s,T]. 

We  have  shown  in  Theorem  4.2  that  FN(t)  converges  to  F  (t)  in 

s  s 

the  uniform  operator  topology,  uniformly  for  0  _<  s  <  t  _<  T.  This 
implies  that  for  every  x  €  X 

lim  G*jx  =  G  x  (4.29) 

N—  3  3 

uniformly  on  [0,T]  and  moreover  |jR*  -  R  l|  0,  also  uniformly 

®rri  3  ,  ,  2  l 

on  [0,T]  ;  Choosing  e  >  0  such  that  £  R£  _>  c  |  C  i  for  £  e  ]R  ,  we 
obtain 


ii RauH  »  u  €  L2(s,TjRl),  N  =  1,2,... 

and  hence 


lim  1|  (R^)"1  -  Rl1!!  =  0  (4.30) 

N-*«  3  a 

uniformly  on.(0,TJ. 

N 

It  follows  immediately  from  (4.27  -  4.30)  that  ♦  (t,s)  converges 

strongly  to  *(t,s).  By  (4.16)  and  (3.7),  this  implies  the  strong 

N 

convergence  of  the  Riccati  operators  P  (s)  to  P(s).  Now  the 

<*  M 

convergence  result  on  ♦  (t,s)  follows  from  the  inequality 
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II  *(t,s)x  -  $N(t  ,  S  )  X  }  i 

<  )  u S(t-T )BR-1  II  II  t(BN)*PN(T)  -  S*P(t)  ]*(T,s)x||dt 
s 

♦  /  ||S(t-t)SR'1(8N)*PN(T)||  ii  *N(  T  ,s  )  x  -  ♦<T,s)x||dT 
0 

and  Gronwall's  lemma.  Thus  we  have  established  the  statements 

(c)  and  (d).  Statement  (b)  follows  from  (c)  and  (d),  since  the 
control  functions  u  ,  u^,  uN  are  given  by  (4.13),  (4.15),  (4.22) 
respectively.  Statement  (a)  is  an  immediate  consequence  of  (b)  and 

(d) ,  since  J^Cu^)  =  <xQ,PN(s)x0>  and  Jg(us)  =  <xQ,P(s)x0>.  If 

G:  X  +  X  is  a  finite  dimensional  operator,  then  the  convergence 
N 

of  P  (s)  in  the  uniform  operator  topology  can  be  established  by 
analogous  considerations  as  those  in  the  proof  of  Theorem  4.2, 
again  by  the  use  of  the  formulae  (4.16)  and  (3-7)  o 
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4.3.  A  special  spline  scheme 

In  this  section  we  develope  a  special  scheme  which  satisfies 
all  assumptions  of  Sections  4.1  and  4.2.  For  N  =  1,2,...  we  choose 
the  meshpoints 


“  *  1*  =  !»•••»?»  j  =  0 , . . .  ,N, 


where 


^  s  “  ^k“l*  ^  =  ^ •  >P  • 


N  2 

The  sequence  X  ,  N  =  1,2,...,  of  subspaces  of  M  is  defined  by 

*"  *  (♦  e  M2  I  ♦  =  5".0  *  »o*“kj  e  Bn>  ' 

The  "basis  elements"  e^,  e^.  are  given  by 

®0  s  (1.0),  =  (0,ej^), 


where 


ek0(r) 


for 

0  elsewhere. 


N  ,  * 

*kj.(T)  S 


“^(t“tk,j-l)I  for  T€  ltkj  -I1* 
for  T€  [tk,j+l,t;kj  J» 

0  elsewhere. 


j  *  1 , . . . |N*1 ,  and 
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(t> 


f  f0r 


0  elsewhere. 


Here  I  denotes  the  nxn  identity  matrix.  The  following  diagram 

N 

illustrates  the  definition  of  the  basis  elements  e.  .. 


Figure  1 

It  is  obvious  that 

dim  XN  =  n((N+l)p+l). 

We  see  that  XN  is  the  subspace  of  all  elements  €  M2  such 

that  is  arbitrary  in  ]Rn  and  is  a  piecewise  linear  ]Rn-valued 
function  which  is  continuous  except  possibly  at  the  delay  points 
-h^  where  jumps  of  arbitrary  size  can  occur.  By  definition  we  can 

always  assume  that  ♦  *  is  right-hand  continuous  on  (-h,0).  Thus 

N  N 

X  is  neither  a  subspace  of  dom  A  nor  one  of  dom  A*.  Since  X 

contains  all  where  e 3Rn  and  is  a  spline  of  first 

order  corresponding  to  the  mesh  { t .  . >  it  is  clear  that  the 

N  2  Hk” 

orthogonal  projections  p  :  M  X  satisfy  hypothesis  (HI)  of 
Section  4.1. 
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For  notational  purposes  we  introduce  the  orthogonal  projection 

p?:  L2(-h,03Rn)  span(e^nl . . .  ,eJJM) ,  i.e.  for  *  =  U0,*1)  e  M2 

1  m  ONI  pw 

we  have  p  4  =  ($  ^p^  ).  Furthermore  we  put 

EN  -  (eN  eN  eN  ) 

h  leO,elO**'*,epN; 

and  denote  by  aN($)  the  "coordinate  vector" 

/  N  N  N  xT  _nl  (N  +  l)p+l )  .  an  c  yN  . 

(a© »aiQ » • • • »apN '  € JR  of  an  element  $  e  X  ,  i.e. 

Eo($)j  <p  e  X  . 


An  easy  calculation  shows 


N,  N  ,  ,nN.-l.N.  *  .  m2 

o  (p  ♦)  =  (Q  )  d  ( <j> ) ,  $  e  M  , 


(4.31) 


where 


dN($)  s  <EN,«J>>m2  =  col(4>0,<e^0,*1>L2>-*.><epN»<fr1>L2> 


QN  =  diag(I,^qNs  I,  ...,^qNe  I). 


The  (N+l)x(N+l)  matrix  q  is  given  by 

15  l\—°,  i 


»S\I 


0 - 0 


2  1 
3  S 

1  1 
5  3 


M 

For  elements  in  X  the  inner  product  has  the  representation 


<♦,♦>  2  =  aN(<>)TQNoN('l') »  ♦f*  €  XN. 


(4.32) 


L\. 


M 

We  have  seen  that  X  is  not  contained  in  the  domains  of  the 

operators  A  and  A*.  However,  these  operators  can  be  formally 

N 

extended  to  all  of  X  in  the  following  way. 

IA*]°  =  A0*°  ♦  \  V1(“V  +  ^  AQ1(t)^1(T)dt, 

k=l  -h 


[A*]1^)  =  ^(t)  +  60(t)(^° 


lim  *1(t)) 
t+0 


+  Pf  MrH^C-h.  )  -  lim  ♦1(T)), 

k=l  K  K  tt-h, 

k 

[A**]0  =  lim  ^(t)  +  A^°, 
t  +  0  u 


[A*<p]1(t)  =  Aq1(t)i^°  -  ■£.  i*;1  (  t  ) 

^  ^  ^ 

+  l  -  ^(-h.  )  +  lim  ^(t)) 

k=l  K  K  K  T*-hR 

+  6p(t)(ap'1'0  "  ^(-h)), 

N 

for  i l>  e  X  where  6  denotes  the  Dirac  delta  impulse  at  -h.  , 

K  N  N  K 

k  *  0,1,..., p.  We  will  introduce  the  operators  A  and  (A  )*  by 

projecting  these  formal  extensions  formally  back  into  the 
N 

subspace  X  .  Since  the  jumps  of  the  function  components  of  elements 
N 

of  X  occur  precisely  at  t  =  -h.  ,  we  have  two  possible 

K  N 

interpretations  of  6^  as  a  functional  on  X  ,  namely  the  evaluation 
of  either  the  right  hand  or  the  left  hand  limit  at  -h.  . 
Correspondingly  we  introduce  the  following  two  types  of  approximate 
delta  impulses  which  can  be  obtained  by  a  formal  projection  of 
in  one  of  these  two  ways.  We  define 


where 


.N  .  :n  n  „  .  . 

4k,+  ‘  E  Yk,+*  k  ’  1»* • • »p» 
*k,-  *  E^Yk,- *  k  5  0 . p"1' 
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QN  N 
w  vk,+ 


col(otej0(-hk),...,ej1|(-hk)) 


QNyJJ  _  =  col(0,lim  e?n(T) . . ,  lim  e*JM(t)). 

K»  T+-h,  10  pN 


T+-h, 


First  observations  are  contained  in 


Lemma  4.4.  a)  For  any  x  €  B  and  $  €  M* 

*^k  +x*^>m2  =  x  (P^  ^  ^  =  i » •  •  •  »P » 

<«?  _x,4>  2  =  xT  lim  (pVxx),  k  =  0,...,p-l. 
K»  Tf~hk 

M  r>  p 

b)  For  as  operators  B  -*■  M  we  have 

K,X 

ll«k  *H  i  ‘I3)1'2  •  *  *  — .p. 

K»+  rk 

ii «!  -ii  i  )1/2,  k  = 


Proof,  a)  Using  (4.31)*  (4.32)  and  the  definition  of  fij.  ,  we  get 

s  <iN^,*x»pN*V  * 
s  <*X>W(pN*> 

=  xT  col(0,eJQ(-hk),...,e^N(-hk))aN(pN^) 


*  xT(p^1)(-hk)( 


The  proof  for  $k  _  is  analogous. 

b)  Using  (4.32)  and  the  definitions  of  $!!  ,  QN  we  get  for  any 

„  _  .  n  K» 


x  e  B* 
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=  (0,...,0,xT)-7-(qN«  l)'1col(0,...>0,x) 
rk 

1  f^|x}2,  k  = 

rk 

where  we  have  used  X  .  (qN)  >  \  .  The  estimate  for  is 

mm  —  o  k  , - 

analogous  a 


Definition  *4.5.  For  any  4  =  6  X^  we  define 


AN*  =  (A0^°  +  \  Ak^1("hic)  +  /  A01(T)^(T)dT,  A) 

k>  1 

+  6?  U°  -  lim  At))  +  I  C ♦ 1  ( — h,  )  -  lim  At)) 

t+0  k=l  K»“  T+‘hk 

N  N  N 

It  is  clear  that  A  is  a  linear  operator  X  -*■  X  .  The  adjoint 
operators  are  given  in 

N 

Lemma  4.6.  The  adjoint  operator  (A  )*  is  given  by 

(AN)**  =  (lim  At)  +  aJA  -  ^0-^ 1 ) ) 

♦  I  if  +  (AkiJ/0  +  lim  *1(T)  ”  A-h.)) 

k=l  K*  K  T+-hfc  K 

;  ,N  / . T,  0  , 1,  .  . x 

♦  fi-.  .(A  1|>  -  <|»  (-h)) 

V  iT  V 

for  ♦  =  (iA*A  e  X^. 


Proof.  By  definition  of  the  adjoint  operator  we  get 
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r 

t 


<(AN)*<M>M2  =  <*.AN*>M2 

=  (♦°)Tt A0<f°  +  \  Ak^(-hk)  ♦  /  A01(t)^(T)dT] 

+  <»1.P?(SJ*1)>L2  +  <«.«o,-(*°  ‘  ^  *1(t))>M2 

♦  Pr  <*>*l  .(^(-O  -  lim  ♦1(t))>m2 

k=l  K»  K  T+-hic 

for  any  4  =  U0,*1),  <|>  =  in  XN.  By  part  a)  of  Lemma  U.U 

we  see 

<♦,6^  U0  -  lim<|il(T))>M2  =  Him  ♦^(t)  )T(<t>0  -  lim  ♦ 1  (  t  ) ) 

u»“  T+0  TtO  T+0 


and 


<"’»6k,-(*1(*hk)  "  ^*1(t))>m2  = 


Tt-h, 


=  [lim  *1(x)]T(*1(-h.  )  -  lim 

K  xt-lv 


t*-hk 

k  =  l,...,p-l.  Furthermore, 


<*1>»1(3?*1,>l2  *  <*1'a?*1>L2  *  J.  ll'1  *1(T>T<^1,(,>dT 

•  •  ^  ii  — 

k 

*  \  lim  ♦1(t)T^1(t)  -  f  ♦1(-hk)Ti>1(-hk) 


k=l  xt-h 


k-1 


k=l 


-  <P?^1)^1>L2 


and 

(*°)T  /  A01(t)^1(t)dT  =  <Aq14'0,*1>l2  s  <Pi^Aoi'f'°)»*1>L2* 
Putting  things  together  we  get 
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l 


<(AN)*4s*>m2  =  llim  ^(O  +  ao*°JT*o  + 

TtO 

+  l  +  lim  -  ^(-h.  )  ]T<t>1  (-h.  ) 

k=l  K 

*  iaJ*°  -  ♦1(-hp)lT»1(-hp)  ♦  <P?(aJi(,°  - 

The  result  now  follows  by  an  application  of  part  a)  of  Lemma  4.4  o 
We  define  the  sets  D  and  D*  by 

6  =  U  e  M2U°  =  ^1(0),  f1  e  W2,2(-h,0  jEn)} 


and 


D*  =  {*  e  M2  |  ij)1  (-h)  =  A^0,^1  +  [  A^4»°X  ( _h>_h  jCW^*2  (-h,0  3P.1 

k- 1  k 

and  A^*0  -  **  e  W1  »2  (-h^-h^  SRn)  ,k  =  1 , . . .  ,p  > . 

Lemma  4.7.  a)  D( A2 )  c  6  and  D((A*)2)  c  D*. 

b)  There  exists  a  constant  such  that  for  any  4  e  D  and  N  =  1,2,... 

II *V*  -  *♦  II  ,  <  Tll*lll  2  2  • 

rr  N 

c)  Assume  that  AQ1  e  W1 ,2  (-hk,-hk_^;  IR^^for  k  =  l,...,p.  Then 
there  exists  a  constant  6Q  such  that  for  any  <i>  e  D*  and  N  =  1,2,... 


I|(an)*pn*  -  avI!m2 
so 


<  max  {||Aj -*0!!  2  n 

N  k=l,...,p  U1  L  (-hk,-hk_1iIR  ) 


*  11*1 11  2  3  „>• 

*z  *(-hk»*hlc-l»  > 
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Proof,  a)  This  is  clear  by  (2.6)  and  Lemma  2.1. 

b)  For  4  =  e  D  we  put  s  p^1.  Then  by  (2.6)  and 

Definition  M.5  we  get 

II  aV*  -  A*|j 

-  ii ( !1Aki*N(“hk)‘*1("hk)i 

♦  £A01(T)UNU)  -  ^(t)  )dT,pN(|-£$N)  '  J1)  II 

♦  lido  .11 1#°  “  lim  ♦N(t ) J  ♦  VlK  _||  1 4>N(“hk)  -  lim  *N(t)| 

u»  t+0  k=l  K»  K  t+-hk 

<  I  l!Alc||  ||*N- ♦1Hir  ♦1|a01hIi2  |(*n-*1IIl2 

k- 1 

♦  IIpM?»"-*1>II  a  tilP?(*1)-i1llL2 

L 

p  — 

+  A1/2IU1(0)  -  lim  *N(t)J  +  l  ( j  $N(-h.)  -  4»1(-hk.)] 
p  xtO  k=l  K  K 

♦  U1(-hk)  -  lim  ♦M(t)|)J 

xt-hk 

<  ijt  ii*kn*  <2p-ix^)1/2ai*1  -  *”11^-  +  iia01iil2II*  1  -*”111.2 

♦  ii&"-;1iil2  ♦  iip?<i1>-i1nL2  . 

Here  we  have  put  p  =  min  r..  Since  |  t -h.  , -h. 

k*l,...,p  *  K 

k  *  l,...,p,  is  the  image  of  ♦1I ^'hk»"hk-i^  under  the  orthogonal 
projection  of  L2(-h.,-h.  .,;3Rn)  onto 

span(ekQ|  t-h^-h^],...^^)  (-h^-h^J),  we  get  from  standard 
estimates  (cf.(381,  Theorem  6.5  and  Exercise  6.1) 

II*1 -♦"ll  2  i  22E|*i||;»||  . 

u  N*  Lr 


S' 
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nil  _  d+  N 

•I  ♦  de* 


2  1 


const . 


N 


Hi1!! 


and 


n  •!  N,  rlx  n  const.  ,,  ‘;1M 

II#  -  P*<#  >11  2  -  - - II#  II  2  * 

L  L 

where  the  constants  are  not  dependent  on  and  N.  On  each 

N  “N  N 

subinterval  [ ~hjc»"hjc_i  1  ♦  =  x  >  where  x  is  the  cubic  type  I 

T  6  A 

interpolating  spline  for  ®(t)  =  /  £  $  (o)dode  (see  for  instance 

lc  k 

138],  Proof  of  Theorem  6.6).  Note,  that  interpolating  cubic 
splines  in  (38]  are  type  I  splines  (cf.[  1  ]).  Prom  (24], 

Theorem  5.7.1  (with  L  =  — ^  and  m  =  2)  or  I12J,  p.  235  (with 
m=r=2,  q=®)we  get 


II*1-  const.  (i)3/2|U1||  2j2  , 

w 

1 

where  again  the  constant  is  not  dependent  on  $  and  N. 

c)  As  in  b)  we  put  ipN  =  p!^1  for  e  5*.  Using  Lemma  2.1,  Lemma  4.6 

and  1J1  e  D( A* )  we  get 


||(AN)*pN*  -  A*# II 

<  ||  (lim  *N(t)  -  ♦1<0),pJ(aJ1*°-U#N) 


TtO 


p-i 


m 

*  I  II  «!  ,11  |Av*°  *  *M('>  -  ♦"(‘VI 

k=l  K»+  K  T+“hk 

*  IUp,J  |Ap*°-*N(-h)| 


<  II  ♦  (2p-l)(^)l/2l  II*1  -  *Ntl  L- 

11  N/.T  0  d*  1  \  /  ,T  0  d+ . 1  \  1 1  ,  mu’  t ,  1  .1 

+  ll^i  Aoi^  “He*  }  "  Aoi^  "d?*  )(>L2+ "de^  “* 


d+/  .1  ,N, 
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Since  €  W1 *2 (-hk,-hk-1 3Rn) ,  k  =  l,...,p,  we  get  from 

(381,  Exercise  6.1, 

N/.T  ,0  d+  .  1»  ,  .T  ,0  d+,lN„ 

NPl(A01*  'da*  >-  <A01*  -do*  >IIl2 


const. 


-  N 


■  I  jT  0  "1., 

max  JIAoi*  “  *  II  „  2 


k=l , . . .  ,p 


L‘("V“hk-liRn) 


where  the  constant  is  not  dependent  on  *  and  Aq^. 
Similarly  as  in  b)  we  get 


II*1  -  *N|lL“i  const. (^) 


3/2 


max 
k= 1 , . . 


[I*1!!  2  2  n 

,P  W  *  (‘Wl®  } 


and 


.  const. 
,2  i  — - 


max 
k*l, . . 


iii1  ii 


,P 


L2(-hk,-hk_1aRn) 


Note,  that  from  the  assumption  on  AQ1,  we  get 

*1^t*'hk,"’hk-l1  e  w2*2^“hic»"hk-l'IRn^»  k  =  Putting  things 

together  we  get  the  desired  estimate  □ 

An  immediate  consequence  of  Lemma  4.7  is 

2 

Corollary  4.8.  a)  If  we  take  D  =  D(A  )  then  hypothesis  (H3,i)  is 

N  N  N 

satisfied  for  the  sequence  X,p,A,N:l,2,...  and  the 
semigroup  S ( • ) . 

b)  If  A01  e  W1’2(-hk,-hk_1SRnxn),  k  =  l,...,p,  and  D  =  D((A*)2) 
then  hypothesis  (H3,i)  is  satisfied  for  the  sequence  XN,  pN,  (AN)*, 
N  *  1,2,...,  and  the  semigroup  S*(»). 

The  next  lemma  establishes  (H3,ii)  for  XN,  pN,  AN,  S(»)  and 
XN,  pN,  (AN)*,  S*(*)>  respectively. 
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Lemma  4.9.  a)  There  exist  constants  M  ^  1  and  u  e  2R  such  that 
for  all  *  e  D(A2) 

||ANpNS(t)*||  <  Mewt  |  ♦  |  2 »  t  >  0,  N  =  1,2,..., 
where  M2  =  |U  II  +  II A*  ||  +  ||A2*|j  . 

b)  Assume  AQ1  e  W1  ^(-h^j-h^^  3Rn*n) ,  k  =  l,...,p.  Then  there 
exist  constants  M*  _>  1  and  w  e  3R  such  that  for  all  ^  e  D((A*)2) 

||  (AN)*pNS*(t)*||  <  M*eut  |  vp  |  *  ,  t  >  0,  N  =  1,2,..., 

where  =  ||^||  +  ||A*^||  +  |  j  ( A*  ) 2 ^  J|  . 

2  2 

Proof,  a)  Since  S(*)  restricted  to  D( A  )  is  a  Cp-semigroup  on  D( A  ) 
equipped  with  the  norm  j*|2,  we  have 

| S(t )♦ | 2  <  Me“t|0|2,  t  >  0,  *  e  D(A2), 

lc  \  dk  1. 

with  some  constants  M  >  1,  <d  e  E.  From  A  4  =  (L( — 
k  =  1,2,...,  <(»  =  ( ^° , ♦^ )  e  D(Ak)  we  see  that  de  de 

II  ♦  llw2’2  —  1^2*  ^  €  ^  * 

? 

Therefore,  for  <p  e  D(A  ), 

||(S(t)^)1||w2,2  <  Meut^|2,  t  >  0, 
and  by  Lemma  4.7,b) 

l|  ANpNS(t  )4*  l|  <  ||AS(tH|(  +  [[  ANpNS(t  )♦  -  AS(t)*|| 

<  Mewt  ||  A#  ||  ♦  ^  MeutU|2 

<  (N  ♦  r0)ewtU|2 
for  t  >  0  and  N  =  1,2,...  . 
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b)  As  in  part  a)  we  have 


|S*('tH|  *  <  Me“t|*|* 

for  t  >  0  and  *  e  D((A*)2).  From  A **  =  (**(0)  +  A^°,A^<|<0  - 

(A*)2*  =  (...,Aj1(*1(0)  +  aJ*u)  -  §e(Aoi*  "ae*1)>  and  the  fact 
that  on  the  intervals  l-h^-h^j  ] ,  k  =  l,...,p,  we  have 

=  W  “  **  it  is  not  difficult  to  see  that 
for  a  constant  <  >  0  depending  on  A^^  the  following  estimate 
is  valid: 


max  II*1 1| 
K- 1 )  •  •  •  }p  W 


P  ?  *  6  D((A*)2). 

2»2  (-hk>-hk.1*n)  2  * 


The  rest  of  the  proof  is  analogous  to  that  for  part  a)  but  now 
using  Lemma  4.7,c)  a 


N 

Lemma  4.10.  Hypothesis  (H2)  is  valid  for  the  sequences  A  and 

(A^)*,  N  =  1,2,...  . 


2 

Proof.  We  introduce  an  equivalent  inner  product  on  M  by 

<♦»*>  *  U0)T*°  +  !  ♦1(T)T*1(T)g(x)dT,  *,  *  €  M2, 

8  -h 

where  g  is  right-hand  continuous  on  [ — h , 0 ]  and 

g(t)  =  p-k  +  1  for  t  e  {-hk,-hk-1),  k  =  l,...,p. 

2 

It  is  clear  that  the  corresponding  norm  II  *  U  g  on  M  is  equivalent 
to  the  original  norm.  In  fact  we  have 

ll«H  <  IUIIg  <  •'FIUII.  ♦  «  k2- 


SinCe  e  XN  for  any  4  e  XN,  we  get  from  Lemma  4.4,  a) 

that 


<6?J  x , «t> >  =  (p-k)xT  lim  4»1(t) 

K»“  s  T+"hk 


for  k  =  0,...,p-l,  x  e  IRn  and  <J>  e  X*^.  Using  this  equation  and 
Definition  4.5  we  get  for  $  e  X1^ 


N*»4»>g  =  +  f  Ak^1  (“hfc)  +  /  AQ1(T)(f>1(t)dT  ]T<>0 

lc*  1  "h 

+  <P?(^^1),*1g>  2+ Pi^°  -  lira  «1(t)]T  lim  ♦1(t) 

1  a  0  T .  _  a n  _ i n 


+  I  (p-k)  [<>1(-h.  )  -  lim  $1(t)]T  lim 


k=l 


tt-h, 


T+-h, 


M  *Y  1 

Obviously  p”($  g)  =  $  g  and  hence 


.N,d+.lx  .d+ .  1  .1  . 

pl(d6*  >»♦  g  L2'  »♦  S>L2 


=  \  (p-k  +  l)  Jk-1  ^(o'Vc-Odx 

k=1  ~hk 

=  \  l(p-k+l)[lim  1 4*1  ( t )  1 2  -  U1(-hv)|2] 


k=l 


T+-h 


k-1 


12  12 

Using  this  and  several  times  the  inequality  aB  <  t  a  +-58 
N  —  it 

we  get  for  ♦  e  X 
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\ 


<AN*,*>s  <  <|A0|  jjV2  ♦HA01llia>IUIl! 

+  \  !  U^-h.)!2 +|U0!2 -|  lim  l*1^))2 

d  k=l  K  d  *  T+0 

*i  f  (p  -  k  ♦  1)  t  lim  |*1(t)  I2-  U1(-hv)|2I 
k=l 

+  |  \  (p  -  k  ♦  1)1  U1(-hfc  .)|2  -  lim  U1(t)|2] 

k=2  T+“hk-l 

l« IUIl|+§  ?  U1(-hk)l2-fU1(-h1)l2 

k”  1 

♦  *  J2(p'k+ 1H^1(“hk-i)|2*  i^-v*21 

=  «!U!!2 

with  w  a  f  +  I Aq 1  +  i  f  lAk|2  ♦  H Aq^ H  2  .  This  proves  (H2*)  with 

IMIn  =IMIg  for  all  N  (cf.  [30],  p.  244).  Since  (H2)  and  (H2*) 
are  equivalent  and  ||SN(t)||  s  ||SN(t)*||  the  proof  is  finished  a 

Lemma  4.10  was  the  final  step  to  show  that  Theorem  4.1  applies 

to  the  sequences  X**,  pN,  AN,  N  *  1,2,...,  and  XN,  pN,  (AN)*, 

N  =  1,2,...,  defined  in  this  section.  The  corresponding  input 

and  output  operators  are  given  by  BN  =  pNB  =  B  and  CN  =  CpN  =  C, 
n  N 

since  H  x  { 0 >  c  X  for  every  N  e  ]N.  Hence  the  approximating 
systems  are  described  by  the  ordinary  differential  equations 

wN(t)  =  ANwN(t)  +  Bu(t ) 

yN(t)  =  CwN(t),  t  >  0,  (£N) 

wN(0)  =  pN$,  $  6  M2 , 

on  the  subspaces  X^. 
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r 


M 


N  2 

In  an  analogous  way  we  can  define  the  operators  A_:  M 

m  m  m  1 

by  taking  the  transposed  matrices  Aq»...,A^  and  A^C*) 
Definition  4.5.  Obviously  all  the  results  of  this  section  can 

M 

also  be  applied  to  the  operators  A^.  Therefore  we  obtain  the 
sequence 


zN(t)  =  (A^)*zN(t)  +  Bu(t ) , 

yN(t)  =  CzN(t),  t  >  0,  (E»*) 

zN(0)  =  pNf,  f  e  M2, 

of  control  systems  on  XN  approximating  the  Cauchy  problem  (E*). 

Now  let  us  assume  that  R  e  3R**A  is  positive  definite,  Gn  e  3Rn*n 

2  2  u  o 

is  positive  semidefinite  and  G:  M  -*•  M  is  defined  by  G*  =  ( G_ 4>  ,0) 

2  u 
for  4>  e  M  (compare  Section  3*2).  Then  we  consider  the  control 

problems  of  minimizing  the  cost  functional 

T 

JN(u)  =  <zN(T),GzN(T)>  +  J{  )yN{t)  |2+u(t)TRu(t)Jdt  (4.33) 

0 

subject  to  (IN)  and  (E^*),  respectively.  The  corresponding  Riccati 
operators  are 


_N .  .  N  N .  .  N  nN, .  .  N 

n  (t)  =  p  n  (t)p  ,  P  (t)  =  p  P  (t)p  ,  0  <  t  <  T, 


and  satisfy  the  following  Riccati  differential  equations  on  X 


N 


^nN(t)  +  (AN)*nN(t) 
-  nN(t)BR_1B*nN(t)  + 
nN(T)  =  G, 


+  nN(t)A 

c*c  =  o. 


N 


0  <  t 


<  T, 


(4.34) 


and 
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+ 


PN(t)  +  A^PN(t)  + 
-  PN(t)BR_1B*PN(t)  + 


PN(T)  =  G. 


PN(t)(A^)* 

C*C  =0,  0  <  t  <  T, 


(^  -  35) 


These  two  Riccati  equations  have  an  interesting  interconnection. 

In  Section  5.1  we  shall  see  that  -  for  a  large  class  of  systems  - 

N  N  N 

there  exists  an  operator  F  :  X  -►X  which  maps  the  solutions  of 
N  N 

(E  )  onto  those  of  (£T*)  or,  equivalently,  satisfies 

(aJ!*)FN  =  FNAN,  B  =  FNB,  C  =  CF*1. 

Under  these  conditions  it  is  easy  to  see  that 

JlN(t)  =  (FN)*PN(t)FN,  0  <  t  <  T.  (4.36) 

It  follows  from  the  results  of  this  section  that  Theorem  4.3  can 

N  N 

be  applied  to  the  systems  (E  )  and  (E^*).  More  precisely,  we  have 
the  following  theorem  which  may  be  considered  as  the  main  result 
of  this  paper. 

Theorem  4.11.  Assume  that  AQ1  e  W1  *2(-hJ{,-hk_1 3Rnxn)  for 
k  =  1 , . . .  ,p .  Then 

lim  ||  n(t )  -  nN(t )  ||  =  0  =  lim  ||P(t)  -  PN(t)|| 

N-**»  N-m» 

uniformly  for  0  _<  t  ^  T. 

For  implementation  of  the  scheme  we  have  to  calculate  matrix 

N  N 

representations  for  the  operators  A  ,  (A  )*  and  B  (as  an  operator 

AN  A  N 

K  X  )  with  respect  to  the  basis  E  .  Formula  (4.31)  shows  how 

N  2 

to  calculate  the  coordinate  vector  of  p  *  for  4  g  M  . 
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Define  the  (N+l)x(N+l)-matrix  hn  by 


.1  .1  0 

2\ 

I  0  \ 

h"  =  0  \  X  0 


0 - 0  | 


and  the  (p(N+l)  +  l) ]nx [p(N+l)+l ]n  -  matrix  n  by 


[a  I AN  aN  +  A  1  AN  AN  +  A  ! 

o!  10  **•  IN  1  A20  *•*  A2N  A2 


hn  = 


N  _ 
h  el 


hNaI 


aJJ  ♦  A  ' 
pN  p 


where  I  is  the  nxn  identity  matrix  and 


.N  T 

h  el 


N 

/  ^01  ^  ^  ^  1  ^  T  ^  ~  i  »  •  •  •  *P  » 
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Lemma  M.12.  a)  The  matrix  representation  [AN]  of  AN  is  given  by 


IAN]  =  (QN)_1HN,  N  =  1,2,...  . 

M  M 

b)  The  matrix  representation  [(A  )*)  of  (A  )*  is  given  by 

l ( AN ) * ]  =  (QN)‘1(HN)T. 

c)  The  matrix  representation  of  B  as  an  operator  3R1  XN  is 
given  by 

[BN]  =  col(BQ,0 , . . . ,0)  €  ]Rf (N+l)p+l]nxi  ^ 

N 

Proof.  [A  ]  is  characterized  by 

«N(AN*)  =  [ANl«M(.)t  *  s  Is. 

On  the  other  hand  we  get  from  (4.31)  and  .  =  ENaN(.) 

aN(AN4)  =  (qVW1*)  »  («K)"1«EN,AN.» 

=  (9N  )'1<£N  ,ANEN>«M  ( ♦  ) , 


i.e. 


ia"j  .  (QN)‘1<EN,AHEN> 


We  only  have  to  show 
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hn  =  <en,anen> 


'  -N  „N-N  -N  .N.N 

<e0>A  V  <e0’A  "lO*  " 

«N  aN‘N^  -N  .N*N  _ 

<eio»A  eo>  <eio»A  eio>  •* 


-N  .N-N  „  • 
<e0>A  epN> 

-N  ,N-N  . 
<e10>A  epN' 


.N  .N-N  -N  .N-N 
k  epN,A  e0  <epN,A  elO  ** 


-N  .N.N  I 
<epN* A  epN>J 


Prom  Definition  4.5  we  get 


„N-N 

A  e0  - 

U0.o>  +  *?.-• 

* 

an.n 

A  ek0  = 

~  i » • • • *p  » 

ftN-N 

A  6kj  - 

•  »  p  »  J  =  1 »  •  •  •  J 

.N.N  _ 
A  ekN  " 

<4*vp?(4»*5!!,-> 

k  *  1 , . . . ,p~l , 

.N.N 

A  epN  = 

(apn*Vp?(ppn»- 

Observing 


<oN  nN^N  w  -  *N  % 

ekj»pl(emi)  l2  "  <ekj»emi  l2  * 

<e!J.  ,6^  =  lim  efj.(x)  (cf.  Lemma  4. 4, a)) 

KJ  *  Tt-h.  KJ 


*  M 

and  the  definition  of  eQ  and  e^.  we  get  the  desired  result 
through  straight -forward  calculation. 

In  order  to  prove  the  representation  for  [(A**)*]  we  use 
(4.32)  and  get 
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r 


N/anT„N,.  ,  .Nw  .  N,lX  N ,  vTrtN  N//ANx*lX 
o  (♦)  Q  l  ( A  )*]<*  (tp)  =  a  (*)  Q  a  ((A  )*<p) 

*  <*,(A^)*iP>  =  <AN*,ip> 

_  N,.N,,TnN  N/m  .  N,.,TtJ,TJ  N,,« 
s  a  (A  ♦)  Q  a  (ip)  =  a  ($)  [A  ]  Q  a  (ip) 

-  N,..T,J.T  N,  .  x 

*  «  (♦)  (H  )  a  (<|>) 


i.e. 


l(AN)*]  =  (QN)‘1(HN)T. 


Finally  we  have  for  any  u  e  3R* 

«N(Bu)  »  aN((B0uf0))  =  (QN)‘1dN((BQu,0)) 

*  (QN)"1  col(Bou,0,...,0) 

*  col(B0,0, . . . ,0)u 

N 

which  proves  the  given  form  of  IB  J  o 

In  order  to  make  use  of  Theorem  4.3  we  have  to  solve  the 
Riccati  differential  equation  (4.34)  in  the  subspaces  If 
in  the  optimal  feedback  law  (3*18)  for  the  delay  system  (2.1) 
we  use  nN(t)  instead  of  n(t)  we  get  suboptimal  controls  uN(t) 
which  by  Theorem  4.3,b)  converge  to  the  optimal  control  u(t). 
The  corresponding  solution  x**(t)  e  of  the  RFDE  (2.1) 
satisfies 


£  xN(t)  a  L(xJJ)  +  BQGN(t), 


where  u  (t)  is  given  by  the  feedback  law 


uN(t)  :*  -R"1B*nN(t)pN(xN(t),x!f),  t  >  0.  (4.37) 
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Taking  matrix  representations  for  the  operators  involved 
equation  (4.34)  takes  the  following  form: 

~  UN(t)l  +  l (an)*  1  lnN(t)  1  +  (nN(t)HANl 

-  inN(t)  ][BN]R_1[BN]T[nN(t) ]  +  [CN]T[CN]  (4.38) 

S  0,  0  <  t  <  T, 

un(t)]  =  (gni. 

N  N  N 

Here  In  (t)J,  1C  ]  and  [G  ]  denote  the  matrix  representations 

N  N 

of  the  restrictions  of  n  (t),  C  and  G  to  X  considered  as 
operators  XN  -*•  X**,  respectively.  From  the  definition  of  C  and  G 
we  immediately  see 

[CN]  =  (C0,0,...,0)  e  e®*! (N+l)p+l]n 

and 


€  (N+l )p+l Inx [ (N+l)p+l]n 


The  transformation 

rN(t)  =  QN[nN(T-t) ] ,  0  <  t  <  T, 


[GN1  = 


Go  0 

0  0 


0  0 


puts  problem  (4.38)  into  the  form 


_d_ 

dt 


.N 


(ANlTrN  ♦  rN(AN} 

-  rN(BN]R'1(BN]TrN  ♦  tcN]TicN), 


0  <  t  <  T, 


(4.39) 
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rN(o)  =  (gn1 


Note,  that  ((AN)*]  =  (QN )-1 I AN ]TQN.  Equation  (4.39)  is  the 

N  N 

standard  Riccati  matrix  differential  equation  (n  (t)  =  n  (t)* 
NT  N 

implies  r  (t)  =  r  (t))  and  can  be  solved  numerically  by 

standard  methods.  In  many  cases  a  method  developed  by  Casti  and 
Kailath  (see  for  instance  134],  p.  304  ff.)  can  be  used 
advantageously.  In  the  case  p  =  1  and  Aq^^  =  0,  for  instance, 
vre  define 


W0  *  AqGq  ♦  GqAq  -  G0BqR“1bJg0  +  CqCq 


and  the  2nx(N+2)n  matrices 


1*0  ° 


Note  that  (F^)^  =  fN(0).  Then 


where 


(4.40) 


^  L*[(t)  =  L?(t)(lAN)  -  (BN]R”1[BN]TrN(t)) 


1^(0)  =  F^,  i*  1,2. 


(4.41) 


2 

Note,  that  this  is  a  system  of  4n  (N*2)  differential  equations 

2  2 

compared  to  the  n  (N+2)  differential  equations  of  system  (4.39) 
(in  case  p  2  1  and  AQ1  =  0). 
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Finally,  let  us  rewrite  the  approximate  control  law  ( it . 37 )  in 
terms  of  the  above  matrices.  For  this  sake  let  us  introduce 
the  real  n*n-matrices  n^t),  n^Q(t),. . .  »HpN(t)  by 


UN(t)]  = 


n“(t) 


inpN(t) 


and  define 


nJ(t,T) 


\  l  (t)\,<,) 

k=l  j=0  J  J 


(it.  42) 


(4.43) 


for  -h  <_  t  <_  0  and  0  t  <  T.  Moreover,  recall  that 
[nN(t) 1tQn  =  QN[nN(t)].  Then  the  control  law  (4.37)  takes 
the  following  form 


=  -R"1[BN]T[nN(t)HQN)"1dN((xN(t),x^)) 

=  -  r"1(Bq,0, . . . ,0) (nN(t) ]TdN( (xH(t) ,x^) ) 

=  -  R'1BQ(n^(t)TiN(t)  +  (4.44) 

*  ?  f  /  e"  (OxN(t.Oa,) 

k=l  j  =  0  KJ  -h 

=  -  R_1bJ  (riQ(t)xN<t)  +  J  niJ(t,r)xN(t  +  T)dT) 
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5.  Structure  and  stability 


5.1.  The  structural  operator 

2  2 

In  Section  2  we  have  seen  that  the  structural  operator  F:  M  -*•  M 

plays  an  Important  role  for  the  state  space  description  of  retarded 

systems.  In  this  section  we  introduce  an  analogous  operator  for 

N  N 

the  description  of  the  approximating  systems  (£  )  and  (ET).  The 
first  step  in  this  direction  is 

Lemma  5.1.  Suppose  that  r„  =  ...  =  r_  and  A„„(t)  =  0.  Then  XN 
— —  l  2p  2 

is  invariant  under  the  operator  F:  M  ■+  M  introduced  in  Section  2.1. 

2 

Moreover  for  every  $  e  M 


pNF*  = 


„N  N. 

F  p  ♦, 


MM  M 

where  F  :  X  ■*  X  has  the  following  matrix  representation  with 

*M 

respect  to  the  basis  E  : 


Proof.  It  is  easy  to  see  that  under  the  assumptions  of  the  lemma 
we  have  (cf.  (2.9)) 


and 


Pek,j  =  K  Ai*i-k+l,N-j»  k  *  l,...,pf  J  =  °»...»N 
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If  Aq1(t)  =  0  and  the  delays  are  commensurate 

(i.e.  hj  =  n^.p  with  p  >  0  and  nonnegativ  integers  0  =  nQ  <  n^  <  . . .  <  np ) , 
we  always  can  satisfy  the  assumptions  of  Lemma  5.1  by  putting 


np  . 

L($)  =  l  A.$(-ip)  with  A  =  A.  and  A.  =  0  for  i  4  (nn , . . . ,n  } . 
i  =  0  1  nj  J  1  up 


Of  course,  this  could  increase  the  dimension  of  the  approximating 
systems  considerably.  We  have  the  following  important  properties 


Lemma  5 » 


2 .  Suppose  that  r^  = 


[FN]QN  -  QN!FN],[FNJHN 


=  r=:  r  and  An. (t) 

p  01 

(h^)tifn ] . 


0.  Then 


Proof.  The  first  relation  is  a  direct  consequence  of  the  special 

N 

block  diagonal  form  of  Q  and 


j  -  l,...,p.  Analogously  we  get  the  second  relation  by  direct 
computation  using 


a"(hN.l) 

J 


J 


1 ,  •  .  . ,p  o 


As  a  consequence  of  the  previous  lemma  we  obtain  the  following 
finite  dimensional  analogon  to  Theorem  2.2: 


Corollary  5. 3.  Suppose  that  ^  =  . . .  =  r  and  fchat  Aq1(t)  E  °* 
Then  the  following  statements  hold: 
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t  >  0 


(i)  FNeA^t 

(ii)  FNAN  = 

.....  _NnN 
(ill)  F  B  = 

Z  €  B4 


=  .<*?>**  N 

«4>- *  ■ 

BN!  cV  =  CN. 

,  and  CN  =  C } XN 


Here  BN 


and  are  defined  by  BN£  =  B£, 


Proof.  Recall  that  (AN)  =  (QN)_1HN  and  [(A^)*l  =  (QN)_1(K^)T. 
Hence  Lenuna  5.2  shows 


[FNJ[AN]  =  IFN)(QN)-1HN  =  (QN)'1[FN]HN 


=  (qn)‘1(h”)t[fn]  =  ((A^)*][FN]. 


This  proves  (ii).  Statement  (i)  follows  directly  from  (ii)  and 
(iii)  is  trivial  a 


The  above  results  indicate  that  -  to  a  certain  extent  -  the 
approximating  systems  (EN)  and  (E^*)  show  the  same  structural 
relation  as  the  original  systems  ( E )  and  (E*).  In  particular,  if 
=  . . .  *  r  and  A1q(t)  =  0,  then  for  every  solution 

wN(t)  =  eA^twN(0 )  +  J  eAN<t"T)BNu(t)dT,  t  >  0, 

0 

of  (EN)  the  function 


N . .  .  _N  N, .  . 
z  (t)  =  F  w  (t) 


is  the  solution  of  (E^*)  with  inital  value  FNwN(0).  The 
consequences  of  statement  (ii)  in  Corollary  5*3  for  the  Riccati 
equations  corresponding  to  (EN)  and  (E^*),  respectively,  have  been 
discussed  in  Section  4.3  (see  (4.36)). 
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5.2.  Criteria  for  stability,  stabilizability  and  controllability 

In  this  section  we  examine  some  basic  structural  properties 

N  N 

of  the  approximating  systems  (I  )  and  (  E  *  )  •  We  shall  need  the 

1  N  -1  N 

following  facts  on  the  real  (N+l ) x (N+l )-matrix  (q  )  h  . 


Lemma  5.4.  a)  Let  IML,  be  the  operator  norm  which  corresponds 

2  ^  — *T  N  N+l 

to  the  vector  norm  jx|^  =  x  q  x  on  $  .  Then 


,  N. -l.N 
(q  )  h  t 


N 


<  1 


for  N  =  1,2,...  and  t  >  0. 

b)  Let  v  e  o((qN)  ^h1^)  and  x  =  col(  xQ , . . .  ,x^ )  e  $N+1,  x  t  0,  such 
that  either  (uq^-h^)x  =  0  or  (wq^-  (h^J^x  =  0.  Then  x^  A  0  and 
xM  t  0* 

N  M  —  1  M 

c)  Let  p  e  a((q  j  n  ]  and  x  =  col( 1 ,0 , . .  .  ,0  )  or  x  =  col( 0  , . .  .  ,0 ,1 ) . 

Then  x  f  range ( uqN  -  hN )  and  x  f  range (uqN-  (hN)T). 

N  -1  N 

d)  Re  n  <  0  for  every  n  e  o((q  )  h  ). 


Proof,  a) 


For  every  x  e 


the  following  equation  holds: 


Re(xThNx)  =  (Re  x)ThN(Re  x  )  +  (Im  x)ThN(Imx) 

=  .  i|x  |2  _  i|x  |2 

2  1  0  1  2  1  N  1  ' 


(5.1) 


Hence  (qN)  1hN  is  a  dissipative  operator  on  (fN+1  with  respect  to 
the  inner  product 


<y,x>N  =  yVx,  x,y  e  <?N+1. 

N  -1  N 

Therefore  exp((q  )  h  t),  t  >  0,  is  a  contraction  semigroup  on 
(fN+1  supplied  with  the  norm  1*1^  (see  for  instance  (32)). 
b)  This  follows  from 
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N  -1  N 

and  the  fact  that  u  =  ±3  is  not  an  eigenvalue  of  (q  )  h  . 

c) x  e  range ( uq^  -  hN)  would  imply  x  ±  ker(yq^-  (hN)T)  which  is 
impossible  by  b). 

d)  Assume  that  w  €o((qN)_1hN)  and  Rep  >  0.  Then  there  exists  an 
x  €  $N+1,  x  /  0,  such  that  (uqN~hN)x  =  0.  By  (5.1)  this  implies 

0  <  (Re  u)xTqx  =  Re(xThNx) 


0 


2 


Hence  x„  =  x„  =  0  and  therefore  x  =  0  by  b)  in  contradiction  to 
0  N 

x  i  0  a 

N  -1  N 

For  every  y  e  $  which  is  not  in  the  spectrum  of  (q  )  h  (in 
particular  for  every  y  in  the  closed  right  half  plane)  we  introduce 
the  vector 


aN(y)  =  coMa^tn)  .  ,a^(y)) 


as  the  unique  solution  of 

(yq^-h^)a^(y )  =  col(l ,0 , . . .  ,0) .  (5.2) 


Moreover,  we  define 


(5.3) 


aj,kU)  =  akU‘N')aN(X_Jif1)  *••**  aN(Alf)» 

j  =  k  =  0,...,N.  Then  the  complex  nxn-matrix 


AN(X)  =  XI 


-  A0  -  L  'Vj,N<0  *  j0  ^ 


.N, 


plays  an  analogous  role  for  the  approximating  systems  (r  )  and 
(E^*)as  the  characteristic  matrix  a(x)  does  for  the  original  systems 
( E )  and  (Z^) .  In  particular  it  determines  their  input  -  output 
behaviour. 


,N , 


Proposition  5.5.  a)  The  left  upper  nxn  block  X  (t)  in  the  matrix 

e(A^]t  coincides  with  that  of  the  matrix  e^AT^  ^  and  its  Laplace 

N  -1 

transform  is  given  by  A  (X) 

b)  Let  wN(t)  =  col(w^(t ) , . . . )  and  zN(t)  =  col(z!?(t ) , . . . )  be  the 

U  %T  M  U 

unique  solutions  of  (Z  )  and  (ZT*),  respectively,  with  initial 
state  zero.  Then 

wjj(t)  =  Zp(t)  *  J  XN(t-s)BQu(s)ds,  t  >  0. 

c)  The  transfer  matrices  of  (zN)  and  (z^*)  coincide  and  are  given 
by 


GN(X)  =  c0an(x)_1b0. 


Proof,  a)  It  is  sufficient  to  show  that  the  left  upper  nxn  block 
in  (XI-  [AN])_1  respectively  in  (XI  -  [(A^)*])'1  is  given  by 
Ax)"1.  Let  X  e  be  such  that  X-jj-f  a((qN)  1hN)  for  j  =  l,...,p 
and  choose  z  =  co1(Zq,0,  . , .  ,0)  e  <£b+p(N+1)n  where  Zq  e  <pn.  Then 
(XI-  [AN])x  =  z  if  and  only  if  (XQN-HN)x  =  z  or  equivalently 


UI- A0)X0  "  ,|1[AjXj,N+ Aj,kXj,k] 


‘0* 


.N  _N, 


( (  1 Q  •  h  )  •  I )  x  j  =  col(Xj^^ 

j  =  i,...,p. 


(5. 5 ;l ) 


( 5  •  5 ;  2 ) 
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Here  x  =  col(xn,x  , .  ...x  ),  where  xn  e  $n,  x.  =  col(x.  x.  K1)  e 

(  N+"l  ^  n  U  1  p  U  J  J,U  J.N 

e  '  with  x.  .  e  $n  and  xn  M  =  xn.  By  definition  of  the 

a.  U(X)  equations  (5.5)  are  equivalent  to 

AN(X)x0  =  z0,  (5.6;1) 

N 

X  j  -  Oj  ^)XQ  *  j  ”  1  >  •  •  •  ^  "■  OjeeefNe  (  5  •  6  J  2  ) 

This  proves  the  statement  on  the  matrix  (XI-  [A  ))  .  Furthermore, 
(XI-  ((A^)*])x  =  z  if  and  only  if  (XQN-  (H^)^)x  =  z  or  equivalently 


(XI  -  Aq)xq  -  x1jQ  =  zQ, 
((x^qN-  (hN)T)  e  I)x.  = 


(5-7*1) 


COl(Aj ,0X0** ** ,Aj ,N-lX0,(Aj  +  Aj  ,N)X0  +  Xj  +  1,0) 


(5-7  *2 ) 


j  s  1 »  •  •  •  »P » 


where  x  ...  n  :=  0.  Since  the  first  row  of  the  matrix  (wqN-  (hN)T)~1 
N  N 

is  given  by  (oQ(u ) , . . . ,aN(u) )  we  see  that  (5-7)  is  equivalent 
to  (5.7.2)  and 


aN(x)xq 


( 5  -  8 ;  1 ) 


! 


r . 


N 


[AiaN(X  N  )  +  k?0Ai,kak(X  N  *  1  X0aN(  * - N'"  N 

(5 • 8  ;2  ) 


r. 


N 


J  s 


This  finishes  the  proof  of  a). 

Statements  b)  and  c)  follow  directly  from  a)  ° 

The  following  characterization  of  stabilizability  and 
detectability  for  the  approximating  systems  (tN)  and  (1^*)  is 
precisely  the  analogon  to  Theorems  2.3  and  2.4. 
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Theorem  5.6.  a)  The  matrix  (AN1  (or  equivalently  [(A^)*])is  stable 
if  and  only  if  det  AN(a)  A  0  for  every  A  e  $  with  Re  X  >  0. 
b)  The  system  (EN)  (or  equivalently  (E^J*))  is  stabilizable  if  and 
only  if 


rank  [aN(x)jBq]  =  n 


for  every  A  e  (f  with  Re  A  >  0. 

c)  The  system  (EN)  (or  equivalently  (E^J*))  is  detectable  if  and 
only  if 


rank 


f aN<*)l 


=  n 


for  every  A  e  $  with  Re  A  >  0. 


Proof.  It  is  well  known  from  finite  dimensional  linear  system 
theory  that  (eN)  is  detectable  if  and  only  if  ker( AI- [ AN ]) n  ker[CN]= 
=  {0}  or  equivalently 

ker(AQN-HN)  n  ker  ICN]  =  0 

ji  ^ 

for  every  A  e  $  with  Re  A  >  0.  But  <f  o((q^)  *hN)  for  Re  a  >  0 

~  w  n  N 

(Lemma  5.^,d))  and  x  =  col(x0,x1 , . . . ,xp)  e  ker(AQ  -  H  )  is 

equivalent  to  AN(A)xn  =  0  and  (5.6;2).  Therefore  detectability  of 

N  ^ 

(E  )  is  equivalent  to 

ker  AN(A)  n  ker  CQ  =  {0} 

for  every  A  e  (t  with  Re  A  >  0.  Analogously  it  follows  from  (5.8) 
that  this  condition  is  also  equivalent  to  detectability  of  (ET)*. 

Statement  b)  follows  from  c)  by  duality  and  statement  a)  is 
a  special  case  of  c)  (put  Cq  =  0)  o 


-68- 


In  the  special  situation  considered  in  Section  5*1  we  can  also 

M 

characterize  controllability  and  observability  of  systems  (E  )  and 
N 

(I,p*)  (compare  Theorem  2.5): 

Theorem  5.7.  Suppose  that  r1  =  ...  a  rp  *  r  and  that  Aq1(t)  =  0. 

a)  Let  x  e  $  be  such  that  xjj  4  o((qN)”1hN).  Then  X  e  o(AN)  if  and 

only  if  det  aN(x)  =  0.  If  X§  e  o((qN)“1hN),  then  Xeo(AN)  if  and 

only  if  det  A_  =  0.  Moreover,  o ( ( A^J ) * )  =  o(AN). 
mP  a 

b)  System  (E  )  is  controllable  if  and  only  if 

rank(AN(x),B0]  =  n  for  all  X  e  ^c( (|qN)_1hN) 

and 

ranklAp,BQ]  =  n. 

N 

c)  System  (e  )  is  observable  if  and  only  if 

N 

rank  [A  (x)]  =  n  for  all  x  e  $  v a ( (SqM)"1hN) 

r  " 

and 

rank  A„  =  n. 

P 

d)  System  (e^*)  is  controllable  if  and  only  if 

rankl aN(X) ,Bq]  =  n  for  all  x e  $  ^ o( (JqN)“1hN) 
and 

rank  A_  =  n. 

P 

a)  System  (E^*)  is  observable  if  and  only  if 

rank  f*N(x)  *  n  for  all  x  e  <f  ^  o( (JqN)"1hN) 

l  co 

and 
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rank 


=  n. 


Proof,  Let  X  e  $va((£qN)  1hN)  or  equivalently  x£  4  «( (qN)-1hN) . 

Then  (5*6)  and  (5.8)  imply  that  both,  ker(XI-A^)  n  ker  CN  =  (0) 

and  ker (XI-  (A^J )* )  n  ker  CN  =  (0),  are  equivalent  to 
1  ,N, 


ker  aN(X)  n  ker  Cn  =  {0},  i.e,  to  rank 


A"(X) 

C„ 


=  n. 


Now  let  Xeo((j~qN)  *h^).  Since  AQ1  =  0,  we  have  A  ^  ^  =  0 , 

0  =  k  =  0,...,N.  Assume  first  that  rank  A  =  n  and  let 

x  e  (£n+P(N+l)n  satisfy  (  XQN  -  HN)x  -  0 ,  [ CN  ]x  =  0.  Then  x  satisfies 

(5.5)  with  zQ  =  0.  Lemma  5*4, c)  implies  xQ  =  x^.  N  =  0,  j  =  l,...,p-l. 

By  (5.5*1)  we  have  Ax  ..  =  0,  i.e.  also  x  =  0.  Now  it  follows 

P  P>N  p,N 

from  Lemma  5 • 4 , b )  that  x.  =  0  for  j  =  l,...,p  and  thus  x  =  0. 

.  J 


Conversely,  assume  that  ker(xi-AN)  n  ker  CN  =  (0)  and  take 

?  e  ker  Ap.  Then  Lemma  5.4,b)  implies  that  there  exists  a  vector 

Xp  =  col(xp^0,. . .  ,xp^N)  €  <J(N+1)n  such  that  ( (  x|jqN  -  hN)  ®  I  ]xp  = 

and  x  M  =  £.  If  we  define  xn  =  0  and  x.  =  0  for  j  = 

then  it  follows  for  x  =  col(xn,x. , . . . ,x  )  from  (5.5)  (with  z_  = 
MM  M  (J  1  P  0 

that  (XQ  -h  )x  =  0,C  x  =  0.By  assumption  this  implies  x  =  0  and 

thus  t  =  0.  We  conclude  rank  Ap  =  n.  This  finishes  the  proof  of 

statement  c). 


0 

0) 


Still  let  X  e  o((|fqN)  1hN).  Assume  that  ker  A  r»  ker  CQ  =  (0) 
and  let  x  e  $n+P(N+l>  satisfy  I XQN  -  (h^)T]x  =  0,  ICN)x  =  0.  Then 
(5.7*2)  with  j  =  p  and  Lemma  5.4,c)  imply  ApxQ  =  0.  This  together 
with  CqXq  =  0  shows  x^  =  0.  Hence  it  follows  by  repeated  use  of 
(5.7*2)  and  Lemma  5.4,c)  that  x^  Q  =  0,  j  =  l,...,p.  Finally  we 
get  from  Lemma  5.4,b)  that  x.  =  0,  j  =  l,...,p,  and  thus  x  =  0, 
i.e.  ker ( xi  -  (a|J)*)  n  ker  C  =  (0). 

Conversely,  suppose  that  ker(XI-  (aJJ)*)  n  ker  CN  =  ( 0 >  and  let 

xn  e  ker  A  n  ker  Cn.  By  Lemma  5.4,b)  there  exists  a  vector 
U  P  U 

o  =  co1(oq,  . . .  ,o^)  e  such  that 
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1 


(x|qN-  (hN)T)a  =  0  and  aQ  = 

We  define  x.  =  col(x.  n,...,x.  M)  e  by 

J  J  J  I1’ 

xl,k  =  “  aq  )xq 

xj  ,k  °kAj-lX0 

for  j  =  2,...,p  and  k  =  0,...,N.  Then  it  follows  from  (5*7)  that 

N  N  T  N 

x  =  coKxqjX^  . . .  ,xp)  e  ker(XQ  -  (HT)  )n  ker(C  }  By  assumption  this 
implies  x  =  0  and  hence  xQ  =  0,  i.e.  ker  Ap  n  ker  CQ  =  {0}.  Thus 
statement  e)  is  proved. 

Statements  b)  and  d)  follow  from  e)  and  c)  by  duality.  The  proof 

N 

of  statement  a)  is  the  same  as  for  c)  with  C  =0  resp.  CQ  =  0  □ 

Remark .  Using  similar  consideration  as  above  we  can  establish 
the  following  partial  generalizations  of  statement  a)  in  Theorem 

5.7:  a)  Suppose  X-j^  4  o((qN)-1hN)  for  k  =  l,...,p.  Then  x  e  o(AN) 
if  and  only  if  det  aN(x)  =  o.  r 

b)  Assume  Aft1(T)  =  0.  If  det  A_  =  0  then  X-^-  e  o((qN)  1hN)  implies 

M  ui  p  N 

X  e  o(AW). 

We  close  this  section  with  a  very  special  result  that  guarantees 
stability  of  (EN)  for  all  N. 

Proposition  5.8.  Let  p  s  1  and  assume  Aq1(t)  =  0.  If 
£  AQ£  <  “  2^1  "  -|t  for  all  nonzero  £  e  ]Rn,  then  Re  x  <  0 

for  every  X  e  o(AN)  and  every  N  =  1,2,...  . 


Proof.  Let  Xe  o(A  ;  for  some  N  and  suppose  that  Re  X  >  0.  Then  there 
exists  a  nonzero  x  e  $n(N+2)  such  that  (XQN-HN)x  =  0.  This  implies 
(observing  the  special  form  of  HN) 
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_J rp  M  _rp  M 

0  _<  (Re  A  )xAQ  x  =  Re(xAH  x) 

=  Re (XqAqXq)  +  Re(xQA1x1^N)  +  RexQxlj0  -  2‘xi,()l  _2^X1,N^ 

<  Re(x^A0x0)  +  -||x0!2  +  ||A^x0|2  <  0 

if  x.  t  0.  This  contradiction  shows  x_  =  0.  Therefore  is  an 
0  N  -1  H  ^  N 

eigenvalue  of  (q  )  h  ,  i.e.  Re  A  <  0  by  Lemma  5.1*,d).  This 

contradiction  proves  the  result  □ 

N 

5.3.  Convergence  of  A  (A) 

The  results  of  the  previous  section  illustrate  the  important 

role  which  the  coefficients  a^(u)  play  for  the  structural  properties 

K  N  N 

of  the  approximating  systems  (z  )  and  So  far  we  have 

treated  them  only  as  implicit  parameters  which  are  given  by 
equation  (5.2).  In  the  following  we  derive  explicit  formulas  for 
the  a^(y)  and  use  those  in  order  to  prove  convergence  of  aN(a)  to 
A  (  A  )  . 


Lemma  5. 9.  a)  Let  the  rational  functions  d™(y),  k 
defined  recursively  by 


=  0 , . . . ,N,  be 


dQ(u)  =  2y  +  3f 

dJJ(u)  =  Hv  +  ,  k  =  1,...,N-1, 


dk-l^ 


(5.9) 


dN(ll)  -  2p  ♦  3  ♦  4^-7 

dN-l(w) 


Then  a”(y)  is  given  by 


<*!J(y)  = 


6( 3-u ) 


dN_kU)‘  ••  .*dN(y) 


(5.10) 


for  k  =  0 , . . . ,N. 
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b)  Let  the  polynomials  pk(y),  qk(u)  of  degree  k+1  be  defined 
recursively  by 

P.^u)  *  Pq(m)  =  2y  +  3 

Pk(y)  s  ^yPjj.^^Cy)  ♦  (9-y2)Pk_2(y) ,  (5*11) 

qk(y)  =  (2p+3)Pk_1(y )  ♦  (9-y2)pk.2(y ), 


k  =  1,2,...  .  Then  these  polynomials  are  stable  for  all  k  and, 

moreover,  y  c  o((qN)_1hN)  if  and  only  if  qv,(y)  =  0.  If 

i  , ,  N.-1N,  ..  N 

v  f  o((q  )  h  ) ,  then 


N/  . 

.k<»> 


6(3-u)kpM.k.1(t) 

qN(u) 


(5.12) 


for  k  =  0, . . . ,N. 

c)  Let  y  i  ±i/3,  y  e  be  given  and  let  w  satisfy 


w2  =  9  +  3y2. 


Furthermore  put 


Tf0  *  2y  +  w,  tj  *  2(  -  w. 

Then  y  e  o(( q^)  1hN)  if  and  only  if 

(3  ♦  w  )2(yq)N  -  (3-w)2(Yl)N  r  0. 
If  y  4  o(( qW)  then 


«k(y)  =  6(3-y)^ 


(3*w)(To)N“k-  (3-w)(Yl)N"k 
(3+w)2(Yq)n  -  (3-w)2(Yl)N 


for  k  *  0 , . . . ,N. 


(5.13) 
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Proof,  a)  Suppose  that  the  functions  =  d^(u),  k  =  0,...fN, 
are  given  by  (5.9)  and  define 


.  -5-u 


.  3-u 


k  dk-l  *  k 
Then  it  is  easy  to  see  that 


dk-l  * 


k  =  1 , . . . ,N . 


6(.qN-hN) 


It  is  not  difficult  to  calculate  the  inverse  matrices.  Since  a^(v) 
is  the  first  column  of  (uq^-h^)  *  we  conclude  that 


6c 


N-k+1 
- cT 


N 


'N 


6 ( 3-u ) 


N-k 


N 


lc  —  0, .  •  #  >N# 

b)  If  the  polynomials  pk(u)  and  qk(u)  are  given  by  (5.11)  and  the 
rational  function  dk(u)  by  (5.9),.  then  we  see  by  induction  that 

dk(w)  =  Pk(u)/Pk_1(w),  k  =  0,...,N-1, 
and 


dN(w)  a  qN(w)/pN-l(u)* 

This  implies 

PkCw )  *  dj(u)*...*dk(y),  k  =  0,...,N-1, 
Qj|(u)  =  d^(u ) • . . ,  *d|J(p )  =  det  [ 6(uqN-h^)  ] . 
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Hence  it  follows  from  Lemma  5.*Od)  that  ( w )  is  a  stable 

polynomial. 

The  considerations  in  the  proof  of  a)  together  with  (5.1*0  show 
that  Pk(»0  is  the  determinant  of  the  matrix 


€  ^(k+DxCk+l)  # 


Hence  it  follows  from  analogous  arguments  as  in  the  proof  of 
Lemma  5.**,d)  that  pk(p)  is  stable.  Finally,  equation  (5.12)  is  an 
immediate  consequence  of  (5.10)  and  (5*1*0. 

c)  Choose  n  e  u  i  ±i/3,  and  define  w,  yQ  and  y1  as  in  statement 
c)  of  the  lemma.  Then  Yq  *  Y1  and 

Y?  -  *OY,  -  (9-P2)  *  0,  i  =  0,1. 


Hence  yq  and  y  are  the  characteristic  roots  of  the  difference 


equation  in  (5.11).  This  implies  that 

„  /  v  _  3+w,  .k+1  3-w ,  »k+l 

pk  '  Tw^V  ~  2w  ^Yi^  * 


(5-15) 


k  =  -1,0,. . . ,N-1.  Using  YqY^  =  i»  -  9  we  get  from  (5.11)  and  (5.15) 


qN(n)  =  (2p+3)pn_1(m )  +  (9 -w2)pn_2(w) 

=  lt2((2M  +  3)(Yo)N  +  (9- w2)(y0)N"1) 

-  ^U2w  +  3)(y1)N  +  (9- p2)(y1)N’1J 


(5.16) 


s  1311) !(y  )«  .  13zw)!{y  }N 

5w 'T0/  2w  VYl'  * 
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N  -1  N 

This  formula  shows  that  y  is  in  the  spectrum  of  (q  )  h  if  and 
only  if  (3+w)2(yq)N  -  (3-w)2(y1)N  =  0.  Moreover,  it  follows  from 
(5.12),  (5.15)  and  (5.16)  that  aJJ(u)  is  given  by  (5.13)  if 
y  4  o((q^)  *h^)  and  y  i  ±i/3  ° 

The  explicit  formulas  in  the  previous  lemma  allow  us  to  prove 

/  M 

that  the  matrices  A  (X)  actually  converge  to  the  characteristic 
matrix  A (A)  of  the  delay  system. 

Theorem  5.10.  Let  Aq1(t)  H  °*  ^hen 

A ( X )  =  lim  aN(a),  x  e 
N-*-« 

the  limit  being  uniform  on  bounded  subsets  of  (J:. 


Proof.  Fix  6  >  0  and  define  w(y)  by 
w(u)2  =  9+  3w2,  Re  w(y )  >  0 


for  any  y  e  $  with  | y |  <  6 . 
and  w(y )  +  3  is  non-zero  on 
that 


Then  the  map  y  •*  w(y)  is  continuous 
|  y  |  _<  6 .  From  w ( y  )  -  3  =  we  see 


|w(y  )  -  3l  <  |  vi  | 2  if  \m  |  <  6. 


(5.17) 


N  u 

In  the  next  step  we  shall  prove  that  a^(ij)  converges  uniformly 
to  e-w  on  lyl  <  c  as  N  -*•  ».  To  this  end  we  use  formula  (5.13) 
for  k  =  N  and  obtain  with  w  =  w(j^),  N  _>  c6 


Nfy .-I 

Vn' 


( 3*w)2 / W+2N.N  _  ( 3-w)2 /  W~2NxN 

12w  '  ■»  iL  '  ~  12w  '  ,  £  ' 

5’N  ^"N 


(5.18) 


From  (5.17)  and  lim  w(^)  =  3  uniformly  on  [y|  <  c  we  see  that 
N-*«  " 
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lim 


(3+w(£))2 


N-»  12w(jj) 


=  l  and  lim 


N»-  12.(5) 


=  0 


uniformly  on  |ui  <  c.  Moreover,  we  obtain  from  (5.17)  also 


w+2i 


77!1,S*  ~  '"T~  -  1  *  S  *  0(^> 

5  N  ^  N  " 


and 


rfi  =  1 
H 


w  -  3  -  — (— )2 
v  .  w  3  3V 

3N  + 


3  “  ( 


*  ♦  fi  ♦  0(J?> 

N  N«i 


as  N  ■  uniformly  on 
show 


u |  <  c.  These  relations  together  with  (5.18) 


lim  “^(jj)”1  ?  ew 

uniformly  on  |u|  ^  c.  Finally,  the  theorem  follows  from  equations 
(5.3)  and  (5.*)  ° 

It  is  our  goal  to  prove  that  stability  (resp.  stabilizability 

or  detectability)  of  the  original  system  ( E )  implies  the  corresponding 

property  for  the  approximating  system  ( Z  )  provided  N  is  sufficiently 

large.  The  first  step  in  this  direction  is  the  characterization  of 

N 

these  properties  in  Theormem  5.6  using  the  matrices  A  (x).  The 

N 

second  step  is  the  convergence  result  for  A  (X)  in  Theorem  5.10. 

In  addition  to  these  results  we  need  a  priori  bounds  for  the  unstable 

It 

eigenvalues  of  the  matrices  IA  1.  This  problem  will  be  considered 
in  the  next  section. 
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5.4.  Uniform  bounds  and  nonuniform  stability 

N 

We  first  establish  uniform  bounds  for  the  a.,  (y)  in  ReX  >  0. 

N  — 

Lemma  5*11*  The  estimate 

is  valid  for  all  y  e  $  with  Re  p  >  0  and  all  N  =  1,2,...  . 

Proof.  Since  a^(y)  is  a  proper  rational  function  without  poles 
in  Rey  >  0  (cf.  Lemma  5.9,b),  it  follows  from  the  maximum  principle 
for  analytic  functions  that  |ajj(y)|  achieves  its  maximum  value 

in  Re  p  >  0  on  the  imaginary  axis.  Therefore  we  only  have  to  prove 
| aJJ(iw )  |  _<  2  for  all  u  e]R  and  all  N. 

We  first  consider  yeilR  with  |y|  >^5.  In  this  case  we  have 
|d£(y)|  >  1 3-y  | ,  k  =  0 , . . .  ,N-1 ,  (5.19;1) 


and 


|dJJ(u)|  >  3  (5.19.2) 

for  all  N.  The  first  estimate  is  obviously  satisfied  for  k  =  0. 
Using 


2 1  u  |  >  (9+  I  v  | 2 ) 1/2  =  1 3  -y  |. 

we  obtain  from  (5*9)  assuming  that  the  estimate  is  already 
established  for  k 
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I Im  dk+i(y)1  =  14  Im  u  -  ■  'j2  Im  dk(vi)l 

>  4|y|  -  >  4  |  y  |  -  (9+  |u  |2)1/2 

-  |dk(y)| 

>  (9+|w|2)1/2,  k  =  0,...,N-2. 

This  proves  (5.19*1).  In  order  to  prove  (5.19*2)  we  note  that 
Re  d^(y)  is  always  positive  (and  decreasing  with  respect  to  k) 
since 


Re  d"  (y)  =  ■  Re  dJJ<y),  k  =  N-2. 

k+1  |dJJ(y)|2  k 

Therefore  the  last  equation  in  (5.9)  implies 

Re  d~<“)  =  3  *  iaf  '(l)ia  Re  d«-1<")  -  3 

which  proves  (5.19;2).  Now  it  follows  from  (5-19)  and  (5.10)  that 


,N(ll)|  ,  2_13ih1_. . . . ._i2=»] - JL 

N  \ i  i jN  /  \i  i 


<  2. 


1  cLq  ( u )  |  |dN_1(y)|  I  dN  ( y )  I 


It  remains  to  consider  y  e  iE  with  |y|  <  /J.  Let  the  complex 
numbers  w,  y  be  defined  as  in  Lemma  5*9 >c).  Then 

w  =(9  -  3 1  w  1 2  )1/2  em 


and  hence 


\yQ\  ~  Kjl  =  I  3-p  |  .  (5.20) 

This  implies  that  there  exists  a  .  p  e  1R  such  that 

(Il)N  =  eip  (5.21) 

Y0 
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Using  (5*20)  and  (5.21)  we  get  from  (5.13)  that 


I  N<-  ^l2 
|on(m)  | 


=  14  4w* 


,,.3-u.N  4w2 

-  3o  |- — |  •  - 5 - —x - n— p 

y0  |(3+w)<i-(3-w)<J(Y1/Y0)  | 

(9+w2) (l-elp)  +  6w(l+elp)j"2. 


The  identities 


=  i|~ f-  and  i  1  -  elp  |  2  =  2-2  cos  p 
.  Ip  1-cos  P  1  1 


1-e 


imply  for  any  a,  b  e  ]R 

| a(l-elp )  +  b(l+elp ) j 2 


2  2 
=  2a  (1  -  cos  p  )  +  2b  (1  +  cos  p  ). 


Therefore 

|ajj(p)|2  =  72w2(  (9+w2)2(1  -  cos  p)+  36w2(l+cos  p)]'1 

.  36w2  _  < 

'  (9+w2 )2  +  36w2  -  * 

p 

because  6w  _<  9+w  o 

Now  we  are  in  the  position  to  prove  the  desired  result  on 
stabilizability  and  detectability  for  the  approximating  systems 
(£M). 

Theorem  5.12.  Suppose  that  Aq1(t)  =  0.  Then  the  following  statements 
are  true: 

a)  If  system  (r)  is  stable,  then  there  exists  an  Nn  such  that 

N  y 

system  (t  )  is  stable  for  every  N  >  N^. 

b)  If  system  (I)  is  stabilizable  (respectively  detectable) 
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then  there  exists  an  NQ  such  that  system  (rN)  is  stabilizable 
(respectively  detectable)  for  every  N  _>  NQ. 

Proof,  a)  Suppose  that  ( E )  is  stable.  Then  det  A(X)  *  0  on 
Re  x  >_  0.  It  follows  from  Lemma  5.11  and  equation  (5. 3)  that 

liA0  +  ?  Aialj  ?  2 J*  !IAJI  =:  <*> 

u  j  =1  J  j  =  o  J 

N 

for  every  x  e  $  with  Re  x  >  0.  Since  A.  u  *  0  for  j  =  and 

J  I*  M 

k  *  0,...,N,  we  obtain  from  (5.^)  that  det  A  (x)  i  0  for  every  N 
and  every  x  e  <f  with  ReX  >  0  and  |x|  >  u>';  Finally,  the  uniform 

convergence  result  on  bounded  domains  (Theroem  5.10)  shows  that 
det  aN(x)  t  0  for  every  x  e  <£  with  Re  x  >  0  and  |x|  <  u  provided 

—  JJ 

N  is  sufficently  large.  Hence  by  Theorem  5. 6, a)  system  (E  )  is 
stable  provided  N  is  sufficiently  large.  This  proves  a).  Statement 
b)  can  be  established  analogously  a 

One  might  now  ask  the  question  whether  stability  of  system  (e) 

N 

implies  stability  of  the  approximating  systems  (E  )  uniformly 
with  respect  to  N,  i.e.  the  existence  of  constants  M  _>  l,  e  >  0 
such  that 

l|eUNltl!  N  <  Me_et,  t  >  0, 

for  N  sufficiently  large  (here  ll.lljj  denotes  the  operator  norm 
corresponding  to  the  vector  norm  jx|^  =  xTQNx  on  ]Rn+p^N+1 ^n) . 

A  result  of  this  type  would  be  needed  in  order  to  apply  a  result 
of  Gibson  (21]  concerning  the  approximation  of  the  solution  to  the 
algebraic  Riccati  equation.  Moreover,  the  uniform  stability  has 
been  recently  stated  as  a  conjecture  [  8  )  for  the  spline 
approximation  scheme  developed  in  171.  Our  result  below  shows  that 
such  a  conjecture  is  definitely  wrong  for  the  approximation  scheme 
developed  in  this  paper.  This  also  indicates  that  it  is  wrong  for 
the  spline  approximation  scheme  in  [71. 


-81 


1 


Proposition  5.13.  Suppose  that  there  exist  constants  M  _>  1  and 


eN  >  0  such  that 


||exp((iqN)"1hNt)||N  <  Me_ENt ,  t  >  0, 


(5.22) 


for  all  N.  Then 


eN  =  0(JJT7^* 


Here  ll*llN  denotes  the  operator  norm  corresponding  to  the  vector  norm 


[x  |2  =  jjjxTqNx  onIRN+1. 


Proof.  First  note  that 


•|xTx  <  xTqNx  _<  xTx,  x  €BN+1, 


and  therefore 


xTx  <  xT(qN)_1x  <  6xTx,  x  €BN+1, 


This  implies  for  xn  =  col(l ,0 , . . .  ,0 )  and  u  €  iR  (cf.  equation  (5.2)) 


N 


I  -  6N 1  o”  (u  >  |  ^  =  6N|  (liqN-hN)"1x0|2 


=  6N  1/  e’wt  exp((iqN)‘ahN  |) (qN)"1xQdt J2 


2  ,  / _N \~1._  ,2  ,7  -_€N  N ...  v 2 


1  6NM  1 (q  )  xQ|‘  <J  e  dt) 


_  6N3M2i/.Nn-1  ,2  6Ncm‘  „T,  N,-l 

s  >  X0>N  =  -T2-  x0(q  >  x 


'N 


2  2 

zx 


36N2M2 


< 


Therefore 


N  „  - 

e  <  6NM  (  l  1  otf*  ( ii )  | 2 ) 
N  ~  k=0 

for  all  p  e  iB. 


2.-1/2 


(5.23) 


Now  let  Mi£  satisfy  |p|  <  /3  and  define  the  complex  numbers 
w,  Yq»  y i  as  in  Lemma  5.9,c).  Then  w  =  /9  -  3  !  p  1 2  e  IR  and 
| Yq |  =  | Ya |  =  1 3  —  u  j •  Hence  there  exists  a  6  >  0  such  that 


This  together  with  (5.13)  yields 

i .  N  ,  m2  _  ,„|(3+w)  -  (3-w)eik5|2 


=  36- 


9(l-cos  k<5)  +  w  (l+cosk6) 


(9+w)  (1-cos  N6)  +  36w  (1+cos  N 6) 


for  all  p e  iR  with  )p|  <  /3.  Since  6  =  6(u)  and  {  +  0  as 
u  i/f,  1  p  |  <  /3,  we  can  choose  a  sequence  pN  e  iB,  |pn|  <  /3, 
such  that  pn  -+■  i/3  and  6N  =  <S(wN)  =  ^  •  The  identity 


sin  6  =  Xm 


Im 


2p-w 

2p+w 


w  v 

w2+4  |p  I 


2 


shows  that  for  positive  constants  c^,  c2 


for  all  N. 


Prom  these  facts  we  get 
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>  const.  N^, 

N  2kn 

where  we  have  used  T  cos  — rr-  <  2.  This  last  estimate 

k=0  N  " 

and  (5*23)  show  that 

1 

Ck|  ^  const.  — t-ttc  o 
N  -  n1/2 

The  above  result  shows  that  exponential  stability  uniform 

with  respect  to  N  is  in  general  impossible  for  our  scheme  -  at 

least  if  A  =0  and  A_„ (t)  h  0.  Numerical  studies  show  that  there 
P  1  N  -1  N 

is  a  sequence  N  =  1,2,...,  of  eigenvalues  A^eoCC^q  )  h  ) 

such  that  Re  x„  -*■  0  and  Im  XM  -*•  •.  In  fact,  the  numerical  results 
N  .  N 

indicate  Re  A  =  0(-^)  for  this  sequence.  In  the  general  case  where 

o((-rf-q  )  h  )  is  nor  part  of  o([Aw])  numerical  studies  still  show 

n  N 

the  existence  of  a  sequence  XN,  N  =  1,2,...,  such  that  *N  e  o([A  ]) 

with  Re  XM  <0,  Re  A„  -*■  0  and  Im  A„  ». 

N  *  N  N 


6.  Numerical  results 


The  spline  algorithm  developed  in  Section  4.3  of  this  paper 
was  applied  to  a  large  number  of  examples.  In  this  section  we 
present  the  numerical  findings  for  some  of  those  examples.  The 
numerical  results  confirm  the  theoretical  results  in  case  of  the 
finite  time  horizon  problem.  Despite  the  fact  that  we  cannot 
prove  convergence  of  the  scheme  for  the  infinite  time  horizon 
problem  using  the  theory  developed  in  [21]  (as  pointed  out  in 
Section  5.4)  the  scheme  performs  also  very  well  for  this  class 
of  problems.  This  is  shown  by  some  examples  which  already  have 
been  considered  in  the  literature  [  8  ]. 

6.1.  Examples  with  finite  final  time 

Here  we  present  examples  where  the  true  solutions  of  the 
control  problems  are  available. 

The  suboptimal  feedback  law  (4.37),  which  is  governed  by  the  matrices 
n^Ct )  ,nj!j(t ) , . . . jnpN(t ) ,  is  calculated  using  the  algorithm  presented 
at  the  end  of  Section  4.3  (cf.  (4.39)  -  (4.43)).  The  controls 
uN(t)  and  corresponding  trajectories  xN(t)  where  calculated  by 
integration  of 

£  i"<t)  =  L(i“)  -  B0uN(t), 

A  M 

where  u  (t)  is  given  by  (4.43).  This  delay  system  was  solved  by 
a  modified  Runge-Kutta  procedure. 

Example  6.1.  This  is  the  problem  of  minimizing 

J(u)  =  |x(3)2  ♦  5  }  u(t)2dt 
£  £  0 
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subject  to 


x(t)  =  x(t-l)  +  u(t),  0  1  fc  _<  T  *  3, 

♦°  =  ♦1(0),  *X(t)  =  1. 


For  this  example  we  have  n  =  1,  AQ1  =  0,  p  =1,  Aq  =  0 ,  A^  =  BQ  : 
Cq  =  0,  Gq  =  -|  and  R  =  ^.  The  optimal  controls,  trajectories  and 
costs  were  calculated  in  (51  using  the  maximum  principle  and 
are  given  by 


1. 


n(t)  = 


5c(t)  = 


-|[(t-2)2+3J,  0  <  t  <  1, 


«(t-3) 

-6 


,  1  <  t  <  2, 
,  2  <  t  <  3, 

,3  4 


l+t-6[^£+|(t-2)3+|],  0  <  t  <  1, 

2 

!+-^-6l4+^(t-l)2+^(t-3)4<~(t-l)~(t-3)2],  1  «  t  <  2, 

"6lll0 +  5(t-2)+|(t-2)2+£(t-2)3-|(t-4)3+-j|_(t-4)5], 

2  <  t  <  3, 


J(n)  =  To  &2 

where  . 


The  numerical  results  we  obtained  are  presented  in  Tables  6.1 
and  6.2., 
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-Zl 

U  (t) 


U8(t) 


0 

0.25 

0.5 

0.75 

1.0 

1.25 

1.5 

1.75 
2.0 

2.25 

2.5 

2.75 
3.0 


J(u) 


-1.2817 

-1.1267 

-0.9882 

-0.8410 

•0.6922 

•0.5885 

•0.5572 

•0.5620 

-0.5623 

■0.5621 


1.4758 

1.2824 

1.1252 

0.9832 

0.8448 

0.7002 

0.5769 

0.5611 

0.5623 

0.5623 

0.5622 


1.7338  1.7338 


ul6(t) 


-1.9679 

-1.7043 

-1.4760 

-1.2828 

-1.1250 

-0.9846 

-0.8445 

-0.7050 

-0.5704 

-0.5623 

-0.5623 

-0.5623 

-0.5623 


1.7338 


u(t) 


•1.9681 

•1.7045 

■1.4761 

-1.2828 

■1.1246 

•0.9840 

•0.8435 

•0.7029 

•0.5623 


•0.5623 


1.7338 


mm 

-8 

x°(t) 

;l6(t> 

0.7914 

0.7916 

0.7916 

0.6448 

0.6448 

0.6448 

0.5511 

0.5506 

0.5507 

0.5007 

0.5005 

0.5005 

0.4589 

0.4593 

0.4595 

0.4083 

0.4096 

0.4094 

0.3655 

0.3642 

0.3646 

0.3375 

0.3372 

0.3371 

0.3159 

0.3167 

0.3168 

0.2845 

0.2848 

0.2848 

0.2403 

0.2407 

0.2408 

0.1874 

0.1874 

0.1874 

0.7917 

0.6448 

0.5507 

0.5005 

0.4595 

0.4094 

0.3646 

0.3370 

0.3168 

0.2849 

0.2408 

0.1874 


We  observe  that  the  error  |uN(t )  -  n(t )  |  is  larger  around  t  =  1 
and  t  =  2  compared  to  other  points  in  [0,31  because  there  u(t) 

*N 

has  jumps  in  the  derivative  whereas  u  (t)  is  continuously 
differentiable  on  (0,31.  In  Table  6.2  we  didn't  include  the 
values  for  t  =  0  because  always  x  (0)  =  x(0)  for  our  algorithm. 


Example  6.2.  We  have  to  minimize 


J(u)  = 


bxl{2)‘ 


x2(2)2) 


I  / 
*  0 


( u1  ( t ) ' 


u2(ty 


)dt 


subject  to 


x(t)  =  °jx(t-l)  +  jju(t),  0  _<  t  _<  2 

♦0  =  ♦1(0),  ♦1(t)  5  |j|. 


We  have  n  =  2,  p  =  1,  AQ1  =  0,  AQ  =  0,  A±  =  ^ 

CQ  *  0  and  Gq  =  r  =  ^j.  Again  the  solution 

obtained  in  [  5  ]  and  is  given  by 


B, 


of  this  problem  was 


Ujft  ) 


v  +  6 (1-t ) ,  0  <  t  <  1, 
u ,  1  <  t  <  2, 


u2(t)  =  6,  0  _<  t  2, 


XjU ) 


1  +  wt  -  -|(t~l)2  +  0  <  t  <  1, 

1  +  vt  -  1  _<  t  _<  2, 


1  +  (l+«)t,  0  _<  t  _<  1, 

.  2  ♦  (l+|6)(t«l)  +  |(t-l)2  -  |(t-2)3  +  |6,  1  <  t  <  2, 


and 


J(u)  =  |y2  +  ♦  |52, 
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SI 

xj(t) 

-  8  / .  . 
x^t) 

xj6(t) 

XjU) 

0.25 

0.76100 

0.76192 

0.76229 

0.76229 

0.5 

0.57691 

0.57927 

0.57908 

0.57906 

0.75 

0.45142 

0.44963 

0.45038 

0.45032 

1.0 

0.57648 

0.37640 

0.37621 

0.37607 

1.25 

0.32751 

0.32893 

0.32905 

0.32906 

1.5 

0.28184 

0.28198 

0.28204 

0.28504 

1.75 

0.23474 

0.23498 

0.23503 

0.23504 

jBEH 

0.18781 

0.18799 

_o .18803 

0.18803 

S3 

x^(t ) 

x2(t) 

0.25 

1.03216 

1.03207 

1.03205 

1.03205 

0.5 

1.06433 

1.06414 

1.06411 

1.06410 

0.75 

1.09647 

1.09619 

1.09616 

1.09615 

1.0 

1.12855 

1.12823 

1.12820 

1.12821  ; 

,  1.25 

1.12961 

1.12939 

1.12940 

1.12941 

1.5 

1.07768 

1.07797 

1.07799 

1.07799  ( 

1.75 

0.98704 

0.98747 

0.98757 

0.98758  J 

2.0 

1 

0.87175 

0.87177 

0.87179 

0.87180  : 

Table  6.4 
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6.2.  Examples  for  the  infinite  time  horizon  problem 


Despite  the  fact  we  cannot  prove  convergence  of  our  scheme 

for  the  infinite  time  horizon  following  the  ideas  of  Gibson  [21] 

the  algorithm  seems  to  behave  very  well  also  in  this  case.  The 

following  examples  show  that  it  should  be  possible  to  prove 

N 

convergence  of  the  operators  n  to  n  in  the  uniform  operator 
topology.  Here  nN  restricted  to  XN  (on  (XI'I)'L  we  have  nN  =  0)  is  the 
solution  of  the  algebraic  Riccati  equation 


(AN)*nN  +  nNAN  -  nNBR_1B*TIN  +  c*c  =  0 


(6.1) 


and  n  is  the  solution  of  (3.21).  Taking  matrix  repesentations 
for  the  operators  equation  (6.1)  takes  the  following  form 
(cf.  also  (4.38)): 

I (an)* ] [nN]  +  [ nN] [ an]  -  I nN) [BN]R_1 [bn]t£ nN ] 

+  (CN]TtcN]  =  0. 

Analogously  as  in  case  of  equation  (4.38)  we  define 

rN  =  QN[nN] 

and  get  the  Riccati  matrix  equation 


IaW  ♦  rNUNl 


(6.2) 


-  rN[BN]R-1lBN]TrN  ♦  lcN]T[cN]  =  o. 


Using  n  instead  of  n  in  the  feedback  law  (3.24)  we  get  by 
analogous  computations  as  in  (4.44) 

uN(t)  =  -R-SX^tW  n^(r  )x(t  +  r  )dr  )  ,t  >  0,  (6.3) 

-h 
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where  n^(x)  =  f  £  (nfj.  )Tet- (t)  and 
1  k=l  j=0  KJ  KJ 

...  *  ) 


(compare  (4.42)  and  (4.43)).  The  numerical  results  clearly  show 
II  -  n  ||  ■+  o  as  N  -*■  ®.  Thus  there  should  be  a  way  to  prove  this 
convergence  without  having  uniform  exponential  stability  for  the 
approximating  problem. 

For  the  examples  (6.2)  was  solved  using  the  Newton-Kleinman- 
algorithm  as  presented  in  ( 34  ] ,  for  instance.  The  Ljapunov  matrix 
equation  which  has  to  be  solved  in  ea;h  step  of  the  Newton-Kleinman- 
algorithm  was  solved  using  the  quadratically  convergent  procedure 
given  by  R. A.  Smith  (391  (see  also  134],  p.  297).  The 
approximating  controls  uN(t )  and  corresponding  trajectories  xN(t) 
where  calculated  as  for  the  examples  in  Section  6.1.  The  following 
examples  were  already  considered  in  [  8  ]  where  the  approximation 
was  done  using  the  spline  scheme  developed  in  t  7  ] . 

Example  6.3.  This  is  Example  4.1  in  18)  and  considers  the 
minimization  of 

09 

J(u)  =  /  lx(t)2  +  u(t)2]dt 
0 

subject  to 

x(t)  =  x(t)  +  x(t-l)  +  u(t),  t  _>  0, 

♦°  =  0,  ♦1(t)  =  sin  irt,  -1  <  t  <  0. 
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In  this  case  we  have  n=p=l,  Art  =  A  =  B0  =  C_=  R  -  1 .  In 

u  1  u  u 

Table  6.5  we  give  the  values  for  J(u  )  and  the  optimal  costs 
JN  =  <nNpN(<>0,(>1)  ,pN(^°,^1)>  for  the  approximating  systems  (EN) 
with  cost  functional  (4.33). 


N 

J(uN) 

JN 

4 

8 

16 

0.321439 

0.321439 

0.321439 

0.321430 

0.321432 

0.321430 

Table  6.5 

N  N 

In  Table  6.6  we  show  the  values  for  n.  and  n„M.  Since 

0  IN  q 

range  n  c  dom  A*  (cf.  Proposition  3«4,b)),  we  have  Aingo*  = 
(niol>0)("l)  for  a11  €  ®n*  Therefore  we  should  have 

n0  “  "lN  -  0  as  N  ♦ 


N 

no 

4 

2.80886 

2.77538 

8 

2.809328 

2.80096 

16 

2.809390 

2.80729 

32 

2.809396 

2.80887 

Table  6.6 


N 

In  Table  6.7  we  give  the  values  for  1^(0,  which  governs  the 

distributed  feedback  in  (6.3),  at  the  knots  -iL  j  -  0,...,N,  for 

N  w 

N  =  4,  8,  16  and  32.  We  clearly  see  that  1Ij(t)  converges  uniformly 
on  -1  <  t  <  0  as  N  -►  •. 


j 

■HES 

B853I 

Bags 

0 

0.63598 

0.63683 

0.63694 

0.63696 

1 

- 

- 

- 

0.66132 

2 

- 

- 

0.68698 

0.68764 

j  3 

- 

- 

- 

0.71558 

4 

- 

0.74240 

0.74512 

0.74553 

5 

- 

- 

0.77722 

6 

- 

- 

0.81040 

0.81114 

7 

- 

- 

- 

0.84695 

8 

0.87064 

0.88269 

0.88474 

0.88517 

9 

- 

- 

- 

0.92547 

10 

- 

- 

0.96750 

0.96839 

11 

- 

- 

- 

1.01361 

12 

- 

1.05757 

1.06113 

1.06165 

13 

- 

- 

- 

1.11225 

14 

- 

- 

1.16491 

1.16591 

15 

- 

- 

- 

1.22238 

16 

1.26664 

1.27879 

I.28151 

1.28218 

17 

- 

- 

- 

1.34508 

18 

- 

- 

1.41048 

1.41162 

19 

- 

- 

- 

1.48157 

20 

- 

1.54972 

1.55463 

1.55547 

21 

- 

- 

- 

1.63314 

22 

- 

- 

1.71381 

1.71512 

23 

- 

- 

- 

1.80125 

24 

1.86588 

1.88693 

1.89104 

1.89209 

25 

- 

- 

1.98748 

26 

- 

- 

2.08649 

2.08802 

27 

- 

- 

- 

2.19358 

28 

- 

2.29692 

2.30348 

2.30477 

29 

- 

- 

- 

2.42147 

30 

- 

- 

2.54253 

2.54432 

31 

- 

- 

- 

2.67323 

32 

2.77538 

2.80096 

_ 

2.80729 

2.80887 

Table  6.7 
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N 

With  respect  to  the  behavior  of  the  scheme  presented  in  (  8  J 

is  comparable  to  the  performance  of  our  scheme.  But  with  respect 

to  approximation  of  the  feedback  kernel  our  scheme  behaves 

much  better  (compare  Figures  4.1  -  4.4  in  (8]).  Our  scheme 

seems  also  to  be  more  accurate  as  far  as  approximation  of 

J(u)  by  J  (u  )  and  J  is  concerned.  In  Tables  6.0  and  6.9  we 

*  M 

present  the  values  for  u  (t)  and  x  (t)  on  0  <  t  <  *1  and  0  <  t  <  3, 

aN  7n 

respectively,  where  u  (t)  is  given  by  (6.3)  and  x  (t)  solves 
^xN(t)  =  L(xJ|)  +  BQaN(t),  (x(O).xJ)  =  U0,*1). 


\uN 
t  \ 

aV> 

u8(t) 

ul6(t) 

0 

0.86836 

0.86817 

0.86816 

0.25 

0.64894 

0.64891 

0.64891 

0.5 

0.49650 

0.49657 

0.49658 

0.75 

0.35400 

0.36400 

0.36401 

1.0 

0.24627 

0.24618 

0.24618 

1.25 

0.16154 

0.16146 

0.16146 

1.5 

0.10999 

0.10993 

0.10993 

1.75 

0.08024 

0.08021 

0.08021 

2.0 

0.06015 

0.06015 

0.06015 

2.25 

0.04348 

0.04347 

0.04347 

2.5 

0.02983 

0.02982 

0.02982 

2.75 

0.01996 

0.01995 

0.01995 

3.0 

0.01373 

0.01372 

0.01372 

3.25 

0.00991 

0.00991 

0.00991 

3.5 

0.00729 

0.00729 

0.00729 

3.75 

0.00524 

0.00523 

0.00523 

4.0 

0.00362 

0.00362 

0.00362  I 

...  . — > 

Table  6.  8 
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i“(t) 


3t0(t) 


il6(t) 


0.25 

0.5 

0.75 

1.0 

1.25 

1.5 

1.75 
2.0 

2.25 

2.5 

2.75 
3.0 


0.11259 

0.05332 

-0.06628 

-0.10850 

-0.06160 

-0.01397 

0.00753 

0.00178 

-0.00784 

-0.01030 

-0.00646 

-0.00178 


0.11258 

0.05331 

-0.06626 

-0.10846 

-0.06158 

-0.01397 

0.00752 

0.00178 

-0.00784 

-0.01029 

-0.00646 

-0.00178 


Table  6.9 


0.11258 
0.05332 
-0.06626 
-0.10846 
-0.06158 
-0.01397 
0.00752 
0.00178 
-0.00784 
-0.01029 
-0.00646 
-0.00178  | 


Example  6.4.  This  is  a  model  for  the  Mach  number  control  loop 
for  the  National  Transonic  Facility  at  NASA’s  Langley  Reserach 
Center.  For  details  see  [  2  ]  or  [  8  J .  The  problem  is  to 
minimize 

J(u)  =  /  (xT(t)cTcox(t)  ♦  u2(t)]dt 
0 

subject  to 


f-a  0  0]  [0  lea  0 

x(t)  =  0  02  1  x(t)  +000  x(t-0.33) 

0  -<»>  -2£w  0  0  0 


(0  1 

♦  loJu(t),  t  >  0, 


(6.4) 


♦°  *  col(-0. 1.8. 547,0)  s  ^(t),  -0.33  <  t  <  0. 


We  have  CQ  =  (100,0,0),  n  =  3,  p  =  1,  k  =  -0.0117,  K  =  0.8, 

w  s  6.0  and  -  =  1.964.  Because  of  the  simple  structure  of  this 
a 

problem  it  is  possible  to  calculate  the  true  solution  following 
an  idea  contained  in  1291.  If  we  put  for  t  ^  0 

Yl (t )  =  x1(t+h),  h  =  0.33, 
y2(t)  s  x2(t), 
y3(t)  =  Xj(t), 

we  obtain  by  a  simple  Calculation 

y^t)  f-a  ka  0  '|fy1(t)'j  0 

^  y2(t)  =00  1  y2’(t)  +  0  u(t).  (6.5) 

ly3(t)J  i0  -a,2  -2««Jiy3(t)J  [u,2 

The  cost  functional  takes  the  form 

J(u)  =  104  /  x.,(t)2dt  ♦  J  lloY.(t)2  +  u(t)2]dt, 

0  1  0  1 

where 

x^t)  =  e"at>J  +  ak  /  e"a^t“T)#2(T-h)dr, 

0  <  t  <  h, 

is  not  dependent  on  u(t)  on  the  interval  [0,1].  Therefore 
minimizing  J(u)  subject  to  (6.4)  is  equivalent  to  minimizing 

J(u)  =  J  (104y1(t)2  ♦  u(t)2]dt 

0  1 

subject  to  (6.5)  with  initial  data 

yj(0)  =  x^h),  y2(0)  =  x2(0),  y^(0)  *  Xj(0).  (6.8) 


(6.6) 


(6.7) 
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The  solution  of  the  latter  problem  is  given  by  the  feedback  law 


tT< t)  =  -  (0t0,u>2)n0y(t), 


where  y(t)  is  the  solution  of  (6.5)  with  u(t)  =  u(t)  and  initial 
data  (6.8).  is  the  solution  of  the  algebraic  Riccati  equation 

ATi0  *  50a  -  n0B0Bj50  *  cjc0  =  o,  (6.9) 

where 


A 


-a  ak  0 
0  0P  1 
0  -«■> 


Equation  (6.9)  was  solved  numerically  to  give 


n 


0 


'8220.51099 

-11.61086 

-1.12107 


-11.61086 

0.01851 

0.00186 


-1.12107' 
0.00186 
0.00019  , 


The  optimal  costs  for  the  original  problem  are  given  by 


J(u)  =  J (u)  +  10^  /  x1(t)2dt 

0  1 

s  yT(0)iny(0)  +  104  /  x  (t)2dt. 
u  0  1 


(6.10) 


Using  (6.7)  it  is  easy  to  calculate  J(u).  In  Table  6  JO  we  give 
the  values  for  J(u),  J(uN)  and  JN  =  <nNpNU°,8l) ,pN(f°,#1)>. 


N 

j<«P) 

- 

4 

136.39587 

136.40499 

8 

136.40094 

136.40509 

16 

136.40250 

136.40521 

J(u) 

136.40490 

Table  6  JO 
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Using  (6.10),  (6.8)  and  (6.7)  we  get  oy  some  calculations 
for  general  initial  data  (♦^j*1) 


.-ah  0  0 


,ro  ■ (n  s  jsms  j;r10' 


a " A  A 

e  oo 


«l-e-2ah  f*  5  51 1.0 


0  0  0 
0  0  0 


T  e  ah  0  0  .  0  1  0  o 

♦  2akU°)  o  lon  ooo  J  ea  r(t)dx 

,0  0  lj  u[0  0  Oj  -h 

+  104ke“ah(*°)T  000  J  (e'ax-eaT)*1(T)dT 

0  0  Oj  -h 

2  2  0  i  „  fO  0  0).  f°  i  0]  0 

♦  a^k  J  ea  (♦  (x))  dx  lOOnOOO  /  eaV(x)dx 

-h  (0  0  Oj  u(0  0  0 j  -h 

+  104a2k2<**(o),  f  e*a( t- • )  j  e‘a( T'a)$J(o)dodx>  2  . 


On  the  other  hand  we  have 


J(u)  =  (♦°)Tn00^°  +  2(*°)Tn01*1 +  <*1»n11*1>i2  ‘ 


Comparison  immediately  gives 


e”ah  0  0).  [ e~ah  0  0 


h  1  -2ah  1  0  0" 

iZ!a -  0  0  0  , 

0  0  0 


"oo'  8  5S  M8  o  ?  * 10 


.  fe-ah  0  0|_  [0  1  0]  0  ftT  . 

n.  ♦  =  ak  0  l  0  n  o  0  0  /  eaV(Odx 

01  (0  0  lj  ul0  0  Oj  -h 

ii  ahf°  1  o)  0  -ax  ax  . 

♦  10 Ve  ah  0  0  0  J  - — — ♦1(x)dx 

0  0  0  -h  44 


or  equivalently,  (ng1^°)(e)  =  n^e)*0  with 
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=  ak 

’0  0  O' 
10  0 

nQ 

fe'ah  0  01 
0  10 

eae  .  lo\e'ah 

'0  0  o' 
10  0 

1°  0  0j 

u 

[0  0  lj 

0  0  0 

-h  <  0  <_  0.  Furthermore,  we  get  after  some  calculation 


(n1141)(0) 


2.  2  ae 
a  k  e 


0  o  o' 

0  1  o' 

10  0 

L 

0  0  0 

lo  0  oj 

V 

0  0  0 

9  ar.l ,  v. 

J  e  *  (t)c1t 

-h 


+  ak 


(0  0  0) 
0  10 
0  0  0 


o  -a } T- e I _  a(T+e)  . 

- - - <j>  (  t  )dt ,  -h  <  e  < 


/ 

-h 


N 

In  Table  6.11  we  present  the  values  for  nQ  and  nQ0  and  in 
Table  6.1 2  we  show  the  values  for  the  second  row  of 

M  U  U 

and  for  j  =  0,...,4.  The  other  rows  of  these 

matrices  are  always  zero. 


N 

_N 

no 

4 

8677.02417  -9.81502  -0.94768' 

-9.81502  0.01851  0.00186 

-0.94768  0.00186  0.00019 

• 

8 

’8677.02698  -9.81505  -0.94768' 

-9.81505  0.01851  0.00186 

-0.94768  0.00186  0.00019 

16 

’8677.03516  -9.81506  -0.94768' 

-9.81506  0.01851  0.00186 

-0.94768  0.00186  0.00019 

© 

o 

a 

8677.02405  -9.81505  -0.94768 
-9.81505  0.01851  0.00186 
,-0.94768  0.00186  0.00019 

Table  6.11 
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-41.39721 

-43.84998 

-46.38019 

-48.99226 

-51.69080 

0.06917 

0.06626 

0.06355 

0.06093 

0.05843 

0.00668 

0.00640 

0.00614 

0.00588 

0.00564 

nj6  <-•$> 

-41.39727 

0.06917 

0.00668 

-43.85012 

0.06631 

0.00640 

-46.38036 

0.06358 

0.00614 

-48.99246 

0.06097 

0.00589 

-51.69102 

0.05846 

0.00564 

>1 

i‘-¥> 

-41.39721 

0.06917 

0.00668 

-43.85008 

0.06632 

0.00641 

-46.38034 

0.06360 

0.00614 

-48.99246 

0.06098 

0.00589 

-51.69103 

0.058.47 

0.00565 

Table  6.12 
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